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EDITORIAL - COMPUTERS AND MUSIC 


by Loren Means 


This special double issue of the YLEM Journal on music has been gestating for several years. It marks the first time that YLEM has issued a 
CD-ROM with its publication. The manuscripts come from a variety of sources. 


| ran across Brian Evans' web page when | was working on the May-June 2000 issue of the YLEM Newsletter, “Artists Using Chance 
Operations.” Brian wrote the article "Chance and a Hidden Order" at my request, but we both agreed that it didn't fit into that issue, since 
he didn't really use chance operations himself. But the article has haunted me since, and | kept promising him | would print it. We met in 
person at last year's SIGGRAPH, and Brian told me of his experiences as a jazz singer in Los Angeles, and of his studies at Cal Arts with the 
renowned composer Mel Powell. Brian told me Powell taught that there were two elements to music, melody and oom-pah-pah. | loved 
that. Brian also told me he had studied with John Chowning at Stanford, a long, long time ago. Brian now creates sounds and images in 
Tuscaloosa, AL, and is a regular contributor to SIGGRAPH. 


| also discovered Lee Spector on the web, in 2001. | was intrigued by his "Genbebop” program, which caused the computer to be able to 
trade improvised phrases with jazz musicians. Lee sent me a manuscript, and | asked him to expand on it. "Selection Songs: Evolutionary 
Music Computation" is a brand-new update of the article. Lee is Dean of the School of Cognitive Science and Professor of Computer Science 
at Hampshire College, where Jon Klein is a Senior Research Fellow and Kyle Harrington Lee's student. Last year Lee's book, “Automatic 
Quantum Computer Programming: A Genetic Programming Approach” was published by Kluwer. 


Andrew Gartland-Jones' article, “Intelligent Interaction: Composing Music with Building Blocks," was submitted by Dennis Summers along 
with the articles that appeared in the July-August 2003 YLEM Journal. Drew was a lecturer in the Department of Informatics at the 
University of Sussex, and head of their Creative Systems Lab. Dennis met Drew at the Creativity and Cognition conference in Lougborough, 
England, in October, 2002. When | contacted Drew's email last year to ask him for musical examples, Theresa Gartland-Jones told me that 
Drew had passed away shortly before. We're printing this article in his memory. 


"Artist as Researcher, Understanding the Tools” by Theresa Gartland-Jones and "Real Kecak System" by Akio Hizume were submitted by Anna 
Ursyn, who has guest edited several issues of the YLEM Journal. Anna had this to say: 


Two themes have been selected for this Ylem issue from the wide spectrum of the Information Visualization Conference: 


(1) Theresa Garland-Jones, Kingston University, UK, “Artist as Researcher, Understanding the Tools” Proceedings of the Seventh International 
Conference on Information Visualization (IV), London, 16-18 July 2003, IEEE Computer Society, Los Alamitos, CA, pp. 619-620). 


Theresa Garland-Jones discusses how computers have permeated the fine art domain and how they affect the creative process. Computers 
are seen as: 


-- Tools for using software metaphors for visual language exploration, and 

-- Tools for influencing metaphors. Arts can offer alternatives in setting research, interpretation of its results, and communicating findings. 
However, much computer art is mediated through the scientist, and artists should engage more with the new technology and the impact 
on their aesthetic, or formal codifying of their creative process. 


We would like to acknowledge Andrew Gartland-Jones' work and his collaboration with Theresa. 


Installation nGen (with the use of i-cube system) combines art and processes called Organic Music created by her late husband, Andrew 
Garland-Jones, who employed Genetic Algorithms to ‘grow’ musical phrases Gato. The project nGen explored visually how to 
represent a continuum of matter and time conveyed through time-based interactive processes. The real-time correspondence between the 
audience, visuals, and music was dependent on the nature of the audience interaction. Virtual zones controlled by the movement of the 
audience contained different images and musical phrases. The installation had live music performance (both improvised and read from the 
computer) as a component part of an interactive event. 


(2) Akio Hizume, Star Cage Institute of Geometry, Japan. 
Akio Hizume presents the Real Kecak System that plays interactive computer music that is infinite. Polyrhythm musical forms correspond to 
innumerable combinations of real numbers. The Real Kecak System is an extension of the Fibonacci Kecak. If Golden Mean (1.6180339) is entered, 


the Real Kecak System plays the Fibonacci Kecak. The Real Kecak System can be played as instrumental music. It was also applied inan installation. 


Topics of the International Conferences on Information Visualization (IV) encompass: digital art, 3D virtual environment and augmented 
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reality, web graphics and web search result visualization for viewing multiple search results, rendering (2D, 3D, and with a time factor), 
collaborative information visualization environment, visual data mining with artificial neural network, medical visualization, and semantic 
web visualization. Papers discuss problems related to many research and industry application fields that involve knowledge construction, 
management and visualization and analyze how knowledge derived from large high-dimensional data sets may serve for effective decision- 
making. Materials for this Conference are published as Proceedings of the International Conference on Information Visualization (IV), IEEE 
(The Institute of Electrical and Electronics Engineers, Inc.) Computer Society, Los Alamitos, California. 


| contacted John Chowning through the good offices of Stephen Brewster of the Computer History Museum in Mountain View, CA, where 
John appeared last December. John came to my house on his way from Marin County back to Palo Alto. While extremely articulate and well- 
spoken, John is also a soft talker, and if found that the karaoke machine | had used for interviews in the past, because it records in stereo, 
had such low gain that he was inaudible. Fortunately, the portable analog and digital machines that | used for redundancy saved the day. 
John then sent me a CD of his works, Wergo WER 2012-50, featuring four fantastic pieces, "Phone," "Turenas,” "Stria," and "Sabelithe,” and 
an equally fantastic long interview from 1987. In that he describes how he used double Lissajous figures as functions for spatial paths in 
his piece "Turenas." | was so fired up by his description, | looked up Lissajous on the web. 


| got in touch with Max Mathews at John Chowning's suggestion, and Max invited me to his home studio, which turned out to be just 
down the hill from my house. My interview with Max was an adventure. Max is an extremely hands-on person Every piece of music or piece 
of equipment | asked him about was demonstrated, with the tape running while Max patched and coaxed his equipment. At one point he 
took me into his living room to show me a DVD, and | had to run back into the studio to get my tape recorder, carrying it around with me 
like a reporter. Max even let me try the Radio Baton for myself, conducting a Bach harpsichord concerto. In fact, Max used classical music 
consistently to demonstrate his equipment, including Mozart and Beethoven's "Fifth Symphony.” Max still plays violin in an orchestra. 
With all the post-modernism around us, Max seems to be something of a pre-modernist, and as knowledgeable about music as he is about 
engineering. 


| met Christina McPhee in person at the reception for the "Recombinant Flux" show | co-curated with William Linn at San Francisco's RX 
Gallery in July of 2004. Christina's “Konza" images were featured in that show, and led to a one-woman show by Christina at RX. When we 
met, Christina introduced me to Henry Warwick, who had featured her in a show he produced on film as performance. Henry joined YLEM 
as a member of the Board of Directors, became Vice President, and layed out the YLEM Journal for an intense year. He also participated 
as a sound artist in a “Pathological Rhetoric” show that | was in at San Francisco's New Nothing Gallery, and in an image and tape show 
at Coyote Point Museum. Henry is now a professor of new media at Jersey City State University in New York, and is sorely missed in San 
Francisco. Henry and Christina are both adept at image and sound generation, a provocative new trend in the arts. 


This was an exciting issue to put together, and will be one of a series on music and technology. 


Dept. of Corrections-in my Editorial for the Jan-Feb issue of the YLEM Journal, | made two egregious errors. For one thing, | said 
that Herbert Franke was “an expert on things Chinese.” Herbert emailed me, saying, "In Munich is living an old man, professor for 
sinology, with the same name as |: Herbert Franke. So | get often mail for him and he gets mail for me, and from time to time we make 
an exchange. (I have never meet him personally.) You see: This mistaking is usual and no catastrophe - but I'm no specialist for Chinese 
things." 


In the same Editorial, | said that Lynn Hershman Leeson had been "relieved of her teaching duties at UC Davis." Lynn emailed me, saying, “| 
was not relieved of my duties at UC Davis. | chose to retire." 


ey 


My apologies to Herbert and Lynn for the misunderstandings on my part. 


ANNOUNCEMENTS: 


YLEM Forums: 


Due to the retirement of our great benefactor, Larry Shaw at the Exploratorium, we won't be able to hold our forums at the McBean Theatre. We have 
shifted our program to the RX Gallery, which is located a few blocks west of Union Square in donwtown San Francisco at 132 Eddy Street. 


Torr 


Loren Means hosted two multimedia events. Ten visual/sound artists participated in the events in fluid combinations, including two working sound/visual 
performing groups. The first event took place at RX Gallery on November 9, featured the groups Live Feed and Reagan's Memory, along with filmmaker/ 
performance artists Rachel Manera and Rachael Abernathy. The second event took place at 21 Grand in Oakland, CA and featured filmmaker/musician 
Eric Ostrowski from Seattle, WA, in addition to Means, Manera, Abernathy, and Reagan's Memory. 
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INTERVIEVY WITH JORN CHOWNING 


by Loren Means 


JC: With the advancement of technology, now an ordinary laptop 
computer has more power than probably all the computers I've ever 
used in the lab, plus special-purpose devices like the wonderful 
Systems Concepts synthesizer that was designed by Pete Samson. 
All of these together, maybe ten times over, exist in a little laptop. 
So the capacity to do fast computation and processing for music 
composition now is kind of unlimited. The capacity surpasses my 
capabilities of conception. There's more power than | can imagine 
using. So the whole world has changed from specialized devices, 
hardware synthesizers, to software. The issues now have to do with 
control. Kinds of controllers, like Max Mathews’ Radio Baton, which 
is an electronic device which allows one to wave an electronic 
baton over a sensing surface, and this sensing surface picks up the 
transmitter signals from the Baton. It calculates distance from the 
surface and angle, so it's a three-dimensional space. That's a kind 
of controller that is maybe typical of what's being done today as 
far as technology in terms of controlling synthesis in real time. Don 
Buchla, who is one of our local geniuses, is also very active in this 
domain. His couple of machines, Thunder and Lightning, which are 
controllers using similar ideas... 


LM: It sounds like a theremin. 


JC: That's right, the theremin was the original controller. Theremin 
is an interesting device, but it's very limited. It's like trying to play 
a violin with one finger on one string. You can play certain kinds 
of melodic lines, but anything that takes articulation-staccato, and 
fast passages that have spaced intervals like thirds, fifths, et. cetera, 
it's very difficult. You really can't do it. 
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So controllers today are of two sorts, I'd say. One is the sort that Max 
Mathews has developed, the Radio Baton, which is at the level of the 
conductor. The other level is more detailed. For example, the glove, a 
special glove that's wired at the centers of the joints and fingertips, 
and so any move of the fingers, thumb, or curvature of the hand is 
sensed. One can control some degree of detail, certain kinds of low- 
level musical activity-pitches, dynamics, it can be anything that can 
be resolved to spatial position. 


So what I've been working on is sort of in between. | have just 
finished a piece for solo soprano and computer synthesis, where the 
soprano has a microphone proximate to her mouth, and the signal 
that's sung is sensed by the computer. Then that is used to animate 
a kind of accompaniment in computer synthesis, or processing, 
reverberation, spatial positioning of the voice, or all of those things. 
That becomes very interesting, because the soprano now is in partial 
control of the accompaniment, and not by any means other than 
that with which she is intimately familiar, of course, her own voice. 
That's the controller. It's not the first time it's been done. Philippe 
Manoury in France did a piece for soprano and synthesis/processing 
several years ago. But it is an idea of using computers that brings 
it pretty close to the kinds of musical expression that we're used 
to experiencing with human performance. The human voice, of 
course, is the instrument of instruments, the first of all, and the one 
which probably has the greatest degree of ultimate control over the 
detail. 


LM: The controllers you're talking about seem to me to be working in 
space, whereas historically in a lot of cases, the controller of choice 
has been a keyboard. Didn't the first Buchla box play single lines? 


JC: All the first early synthesizers were monophonic, and Buchla's, as 
| remember, had a ribbon, so he could create glissandi with that. It 
was ingenious. Don Buchla is quite an extraordinary person. We don't 
compare easily people like Buchla and Moog, but if | were to venture 
a comparison for local consumption, I'd say Buchla is somebody who 
has really kept his nose ahead of everything regarding technology. 


LM: | remember hearing Don jamming on synthesizers with Allen 
Strange at 1750 Arch Street in Berkeley in the Seventies. But a real 
innovation you brought about in the Seventies was with moving 
sounds around in space. Was that your invention? 


JC: It had been touched upon. | really feel an intellectual and artistic 
obligation to make attribution, because it's an idea that Varese had 
in his mind when he wrote the work for many, many, many channels 
at the Phillips Pavilion at the Brussels World's Fair. 


LM: 1958. "Poeme Electronique.” But it seems to me there are pieces 
by Corelli and the like where they'll put brass instruments around 
the stage and pass the sounds around. 


JC: Gabrielli, in Venice. Those were poly-choric pieces. So the idea 
of using space is not a new one. In fact, | got the idea of moving 
sounds in space from Stockhausen, who used the idea of moving 
sounds to some extent in one of his early works. In "Kontacte," a 
piece for piano and percussion and tape, he used 4 microphones 
arranged in a square in the center of which a loudspeaker rotated. 
The microphones then sent the resultant signals to a 4-channel tape 


recorder. So he was able to create some motion in space. 
LM: And that was in the Fifties. 


JC: 1959. So when | started working with computers in '64, that idea 
had already been in the musical mind, in a larger sense, of electronic 
music. What | did was generalize it and more or less make a physical 
model of moving sound sources including Doppler shift and arbitrary 
positions in both angle and distance. So it was a big step, and it's 
still kind of a basic idea, used in theater sound systems and what 
not. It was an exciting moment in the work that | did at Stanford, 
because in doing that, also, | learned how to program, and realized 
that programming was more than simply getting a task done. It was 
a whole universe of possibilities that | had entered upon. | realized 
that this computer was no longer, in my mind, just the alternative 
to an analog electronic music studio, but a wholly different thing, 
primarily because of the power of programming languages. 


LM: When you say “Doppler,” you're talking about the fact that a 
sound appears to get louder as it moves past you... 


JC: Doppler shift is really a frequency shift, so the pitch changes. 
It also gets louder as it comes toward you and moves away. But 
it's something which we're extraordinarily sensitive to in our world, 
because we depend upon that for 
our life. If we hear a bus coming, 
or a horn blowing, and the pitch 
is increasing, Doppler shift tells 
us that this thing is not only 
coming, it's coming fast, and it's 
close. It's a kind of cue that's 
had a quick evolutionary growth 
in human perception. After all, 
before the Industrial Revolution 
and trains, Doppler shift was not 
an important part of our acoustic 
experience. 


AS bil A MB, 


LM: | went to a demonstration 
you did at Stanford in the 
Seventies, and people would duck 
as sound moved over their heads. 
You also could change the timbre, 
and make one instrument sound 
change into another instrument 
sound in the process of moving. 


The Thunder Interface 


JC: And that was using Frequency Modulation synthesis, which 
yielded a lot of power over timbre with a few number of controls. 
That developed right after | finished the spatial simulations. 


LM: How were you generating the sounds in space before FM 
synthesis? Were you using sine waves and such? 


JC: | was using any sort of signal, square waves, standard waves. 
Then in ‘67 | discovered the idea of modulating a sinusoid's pitch 
rapidly by another sinusoid. That is a special case of Frequency 
Modulation that is used in radio broadcasting. The same formulas 
apply, only in this case we don't demodulate. It's all in the audio 
band. It's kind of counter-intuitive, but allowed me to produce a 
large number of timbres with a very small computational engine, a 
couple of oscillators and a couple of envelopes. So with that kind 
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of control, it was very simple to change timbre. As sounds passed 
through the space or over the space, it was possible to make these 
metamorphoses of timbre ... like Escher does in his engravings. 


LM: How did you actually find that FM worked? 


JC: FM was an ear discovery, it was not an engineering discovery or a 
scientific discovery. | was experimenting ... toying with parameters. 
| was creating a vibrato over a pure tone, a sinusoid, and | kept 
increasing the vibrato rate and its depth. Vibrato is the effect 
produced by a violinist who rotates the finger... 


LM: ...The pitch moves up and down around a fundamental pitch... 


JC: ...And usually it's within less than a semitone, plus or minus the 
average pitch. 


LM: Usually you'll make it wider as the pitch is sustained, to add 
interest to the sound. 


JC: So violinists use, it singers use it, most... 
LM: ...Trombonists use it, and you can see the slide movement. 


JC: Oboes, all the instruments use 
it except French horn. 


LM: The bebop revolution in jazz 
wouldn't allow vibrato. Miles 
Davis said, “Don't use no vibrato. 
When you get old you'll shake 
UE T. anyway. 
JC: Anyway, this is what | was 
doing. | was experimenting 
with just a sinusoid and kept 
increasing the vibrato rate, so all 
of a sudden it didn't sound like 
listening to a change in pitch 
in time, but rather | began to 
hear timbral differences, sound 
quality differences. So the vibrato 
became very, very fast, hundreds 
of times per second, and very, 
very deep, as if the violinist 
had a different fingerboard, and 
the finger was whipping up and down at very high rates and very 
great distances. That would be sort of a physical metaphor for this. 
What | was hearing was timbral changes. And this was done with 
only three controls: the frequency around which the vibrato was 
occurring, the rate at which it was occurring, and the amount, what 
we call the depth. So with these three controls and two oscillators, 
| did a number of experiments and got percussive tones, brass-like 
tones, and woodwind-like tones. That's when | realized that there 
was enormous power here that was predictable. After | had done 
a set of experiments, | then asked an engineer, George Gucker, for 
some help in understanding what physically was going on. So we 
pulled out the engineering text by Turman, a Stanford professor, and 
looked at the equation in detail. It certainly predicted what my ear 
was telling me was happening. So that was the beginning of FM. 


LM: | talk to artists and roboticists who are using principles of 
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emergence, and they keep getting back to this delightful element 
of surprise. 


JC: That's right. It wasn't an invention as much as it was a discovery. 
It was always there. And ever since, it's been full of surprises for 
everybody who has ever used FM. The DX-7, | think, had more 
surprises per user than any other instrument that's ever been on 
the market. 


LM: That's the Yamaha synthesizer. 


JC: That was their first popular implementation of FM synthesis. They 
had another instrument or two before, but they were not so general, 
and one was larger and more expensive, the GS1. Quincy Jones 
still has one. It was a beautiful, piano-like instrument, and it had 
a wonderful keyboard feel. But the DX-7 was the first one that was 
within the price range of synthesizer buyers. It had some attributes 
that made it absolutely distinctive, 
that Yamaha never anticipated 
would be so widely accepted. One 
of the attributes was the fact that it 
had velocity sensitivity that could be 
coupled to timbre, tone quality. That, 
| think, is one of its most distinctive 
features, because that's a feature on 
which really good musicians depend 
to make the performance expressive, 
like a pianist who spends hours and 
hours learning to control the rate 
at which that key is depressed in 
relationship to the context of the 
surrounding keys. Most synthesizers, 
and even the B-3 organ, still a 
popular musical instrument, did 
not have that attribute. It doesn't 
matter how hard you hit that key, 
it's always going to be the same 
loudness, depending upon the pedal. 
But the pedal doesn't allow you to 
control that note-to-note velocity 
which relates to loudness and 
timbre, an important detail, whereas 
the DX-7 allowed you to do that. 


LM: That instrument came into being 
because of your work at Stanford. 


Donald Buchla 


JC: | discovered the FM synthesis in ‘67, and then did some work 
with it in the intervening years, but it wasn't really until '71 that | 
rethought an article that Max Mathews and Jean-Claude Risset had 
published in ‘65 about an analysis of the trumpet tone that they 
had done at Bell Labs. So in ‘71 | thought about that article and 
a discussion I'd had with Jean-Claude, who had done most of the 
research on that particular aspect of the work. | realized that there 
was a way to use FM that was extremely powerful, coupling this 
idea of velocity or force or breath pressure or effort to timbre and 
loudness or intensity. That was a key insight. At that point, Stanford 
contacted a number of instrument companies to see if they were 
interested in producing instruments using this technology. None 
of them understood, because they had no idea about the digital 
domain at that time, except for Yamaha. They sent an engineer to 
Stanford, and he understood immediately what the issue was, and 
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the problems it solved. They were already interested in the process 
of developing digital synthesis based upon other technology. So they 
took an option ona license and finally signed an agreement with the 
Office of Technology Licensing at Stanford, to whom | had assigned 
the rights. 


LM: You had been fired by Stanford when this happened? 


JC: Yeah. About 1973 | lost my job because | didn't get promoted 
from Assistant Professor to Associate Professor. So | was let go. 
That's the break point in the ladder of academia. If you make it 
from Assistant Professor to Associate Professor and you get tenure, 
you have a job. But | didn't. It was a curious coincidence of things. 
In that very year, Yamaha had taken their option. In the same year, 
Pierre Boulez had contacted me through Jean-Claude Risset, and 
asked me to help in founding his studio in Paris, IRCAM [Institut de 
Recherche et Coordination Acoustique/Musique]. That was his big 
project in the Seventies. So | lost 
my job, and then at the same time, 
all of a sudden, the work that | 
and people like Andy Moorer, John 
Gray, Loren Rush, and some other 
people had been doing at Stanford 
became of interest to one of the 
most renowned musicians of our 
day. 


LM: You had already formed 
CCRMA [Center for Computer 
Research in Music and Acoustics] 
at this time.. 


JC: Yeah, in '75, actually, although 
the work had been going on since 
‘64. | was in Berlin for a year, 
then came back as a Research 
Associate, because | had no 
other place to work. There was 
no other computer facility which 
was equivalent. And of course we 
had invested all this energy in 
the software that was there. So 
we kept working, and got some 
grants from the National Science 
Foundation and from the National 
Endowment for the Arts. 


LM: So you were working at Stanford even when you didn't have a 
job. 


JC: Well, | was a Research Associate, so it was dependent upon 
outside money. 


LM: And then they hired you back as a professor. 


JC: Then the UC system offered me a full professorship, so Stanford 
did, as well. 


LM: And this is unprecedented, for a university to hire somebody 
back that they had let go? 


JC: It is truly rare. | think a dean once told me that it was the first 
case they can remember. 


LM: It's like Stanford shot themselves in the foot and then noticed 
they were bleeding. 


JC: It's not surprising. At that time computer music was weird. To 
most humanists, the idea of not just using computers to analyze 
music, but actually to make the sound, seemed like a pretty large 
jump for a university to make. Listening to some of those early 
sounds that were made back in the Sixties, they were generally 
pretty raw. Had | not had any deeper understanding, | probably would 
have thought twice before thinking that this idea of computer music 
has a future. But in ‘64, '65, | realized that with this program, with 
some modest ability at programming, | could create this magical 
sound space with just programming, without having to know how 
to solder, without knowing anything about electronics, without any 
intervening engineer. | realized that there was a power here that had 
an enormous future, that we had just begun to touch upon. 


LM: You've composed using the Golden Mean. 


JC: That's interested me, and not from a typical metaphysical 
motivation. My _ interest 
in that is because after | 
finished "Turenas," which 
was the piece that exploited 
this moving sound source 
(finished in 1972) | did some 
experiments with inharmonic 
spectra. In “Turenas" | used 
the square root of two ratios 
and other common irrational 
numbers, and | looked for 
others. The Golden Mean 
surfaced at 1.618. It's that 
ratio, the Golden Proportion 
or the Golden Mean, that 
reaches back to antiquity. It's 
used in Greek architecture, 
and is found in nature. My 
interest began because it had a compelling kind of timbre in its 
simple FM synthesis formation used to create inharmonic spectra. 
So | started thinking about inharmonic spectra in relationship to a 
complementary tuning system as an analogy to the harmonic series 
and our common tempered system tuning system. 


Donald Buchla 


LM: What do you mean by “inharmonic spectra?" 


JC: The non-musical acoustic world is basically chaotic and 
inharmonic, the relationships of frequency partials which are not 
in simple integers. But this chaotic world, like gongs, cymbals, 
wind, noises of nature, can be orderly if we have computers. With 
computers we can organize spectra that are inharmonic to be quite 
as orderly as the harmonic spectra are in nature. So | took this idea 
and developed it in a piece, "Stria," which is based upon the ratio 
of the Golden Mean, to create the actual quality of the sounds 
themselves. Then | structured the pitch space to be based upon a 
scale that is complementary to the spectra in the sense that spectral 
frequency components and scale step frequencies are the same or 
close, as octaves, fifths, 3rds, etc. are found in the harmonic spectra 
of musical instruments. Then the proportions of the piece, the 
various formal aspects of the piece, were also related to the Golden 
Mean. That was probably the most exciting compositional project 


I've ever done, because as you were mentioning earlier, so many of 
us find these surprises when we confront technology with artistic 
ideas. That piece surprised me at every instant in its composition. 


| built a pretty complicated computer program to produce this 
piece. | continually fine-tuned the program at every compositional 
decision. Listening, making an adjustment, adding features, changing 
features, until | had this magical box which | could give directions 
to, which would then produce all these sounds based upon decisions 
| had made earlier. | knew what was in the box, because | had built 
everything that was inside it, but the moment when | actually used 
it, | didn't have to think about all this detail. | would just give the 
instruction to begin at such and such a time in a certain frequency 
space, and make it so long and with a certain kind of density, and it 
would just do it. Though nothing in detail was a surprise, the whole 
thing was kind of a huge surprise every time | implemented this 
procedure. So it was extremely exciting. 


It was almost an organic relationship with this computer which 
represents tens of thousands of man-years of thought about thought 
... the idea of logic and all the stuff that's inside a computer ... all 
that was interacting with me 
in this musically organic way. 
It was like | was being hugged 
by Newton and all these great 
people in computer science. 
It was like they were all part 
of what | was doing. It was 
an extremely satisfying and 
amazing experience. 


"Stria," | thought about 
beginning in ‘73 when | 
was in Berlin, but | had no 
computer, so | did all of the 
calculations and planning by 
hand, what | would do when 
| could realize it. Then when | 
got the position as Research 
Associate in '75 at Stanford, | did some more thinking about it. | 
didn't really start programming it until the summer of '77, when 
Luciano Berio asked me to do a piece for the opening concert of 
IRCAM in Paris at the Centre Pompidou. 


LM: How did you learn to program? 


JC: | read Max Mathews' article that was published in Scientific 
American in November ‘63. It was passed to me by someone in the 
Stanford orchestra who knew | was interested in contemporary music 
and maybe | had said something to her about electronic music. Her 
husband was a doctor at the medical school. | didn't subscribe to 
Scientific American. | never had seen the magazine. | put the article 
in my pocket, and then maybe a couple of months later | found it and 
read it. This was Max describing the use of computers to generate 
sound. | had heard electronic music at the Domain Musicale series 
in Paris during the previous three years when I'd studied with Nadia 
Boulanger. So | thought, "Maybe this is a way to compose electronic 
music.” | thought we might use computers at Stanford, as we had 
no electronic music studio. 


So | looked in the course catalog, and there was a course for non- 
engineers in Algol. So | took the course. It was amazingly easy for 
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me, because they taught this course not programming engineering 
problems, which was the way most every programming course was 
taught in those days, but rather they looked for ways to engage this 
population of people--it was a small group of us--in terms of solving 
problems that we posed. So | thought, "I'll generate a whole bunch 
of twelve-tone rows.” Although | wasn't so much interested in that 
kind of music, it was a tractable problem. So | solved the problem, 
and in doing so | learned how to program, at least the basics of 
programming. Then when | really wanted to do something, the 
following summer, | was prepared. | got from Max Mathews at Bell 
Labs a box of cards with the basic program for music synthesis. 


LM: | like that idea that instead of giving you the program on a disk, 
he gave you a box of cards. | started programming using punched 
cards, too. Were you influenced by Lejaren Hiller and the “Illiac 
Suite?" That was the first computer composition | ever heard of. 


JC: Hiller not much. He did different 
things. He was actually preceded by 
Barbaud in Paris, and Xenakis, both 
of whom used computer language for 
higher-level music programming at the 
score level rather than sound synthesis. 
| think the real richness of this medium 
began with sound synthesis, and then 
developed into compositional algorithms 
which were related to synthesis. It was 
there that the integral nature of music, 
and how all these levels of control inter- 
relate, developed out of Max Mathews’ 
program having to do with sound 
synthesis. And one of his early examples 
is stunning in its implications, far more 
stunning, | think, than what Hiller did. 
Although the sound and the musical 
representation may have been not so 
interesting, the idea was extraordinary, 
which was a metamorphosis between 
two tunes, like some common-known 
folk tune and another common-known 
tune. He created this metamorphosis at the musical, structural level, 
which is really compelling. 


Jim Tenney was really important. He's now at Cal Arts. Jim Tenney 
was given by Max and John Pierce the right to do some work at 
Bell Labs in those days, as was Lillian Schwartz. John Pierce created 
this umbrella of protection for artist's work, including Max himself, 
because music was not his task at all. Here was this institution, 
which at that time was probably the greatest concentration of brain 
power on earth, engineering/scientific brain power. These artists 
were allowed to work there, all because of Pierce and Mathews. Jim 
Tenney was one of these people. He is a wonderfully imaginative 
person, and he did a piece for computer which was based upon 
random processes. He wrote an article for the Yale Journal of Music 
Theory describing Max's program, which was very important to my 
initial understanding. It was published in ‘63 or ‘64. 


LM: ls there a contemporary equivalent of the Yamaha machine that 
is taking computer music to another level? 


JC: | don't know what's really going on in the commercial synthesizer 
world. | never really tracked that very carefully, because it wasn't very 
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close to me. It was a consequence rather than an interest, although | 
certainly spent plenty of hours in Japan helping them develop it. It's 
not really my world. | think that in pop music, mostly it is samplers 
now. Mostly what people want in popular music or commercial 
music, for films and TV and commercials and advertising, is 
instrumental sounds and natural sounds. At the time the DX-7 came 
out, sampling was not viable, because memory was so expensive. 
So most of the interest in the DX-7 was the fact that one could 
get somewhat realistic approximations to acoustic instruments. But 
then memory became so inexpensive that they just recorded sounds 
digitally and then played them from a keyboard or computer. 


LM: My question is, why synthesize instruments that are already 
there instead of creating sounds that were never there before? 


JC: That's because you're thinking ina different domain than somebody 
who is asked to give us violin sounds for a 
TV show, for example. It's a wholly different 
thing. That's why it's not very interesting 
to me. My whole interest is in what we 
can do that touches the imagination in a 
way that it has never been touched before. 
| was seeking a way of understanding 
some of these intricacies that existed in 
natural sounds. These sounds seemed to 
have components that are important to 
our perception, that are independent of 
whether something is natural or unnatural. 
Does the sound have a dynamic quality 
that is attractive to the perceptual system? 
Simulation of the vocal tract became very 
interesting because it's so complicated. 
| did some FM synthesized singing voice 
experiments to try to understand how the 
voice worked, and then that resulted in 
a piece, “Phone,” (1981), which is based 
upon the metamorphoses of sounds that 
become voice-like just momentarily, and 
then transform continuously to some other 
timbre. So to that extent, our interest 
in simulating natural sounds was important, but that wasn't the 
end. The point was to experiment to understand, and then to do 
something creative with that knowledge. 


LM: I'm wondering about the controversial concept of the computer 
doing the composing. 


JC: For me it's not a controversy. There's a whole continuum of 
questions that relate to the degree of computer use, the degree 
to which it is composing. If a human writes the program, and 
then you put your nickel in and get your composition out, is the 
computer composing, or is the programmer directing the computer 
to compose? It's not an obvious answer to the questions regarding 
computer composition. In the case of “Turenas", | used Leland 
Smith's composing program but | wrote sub-programs to control 
the spatial aspects of the piece. In both "Phone" and "“Stria," | 
wrote the entire program to automate certain processes to different 
degrees, but those processes were authored by me. At the moment 
of composition, however, those processes were independent of my 
specific directions. So what is an automatic composition? 


CH 
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CHANCE AND A HIDDEN ORDER 


by Brian Evans 


Meaning, a much maligned yet simple word. Western culture has 
mired itself in a philosophical tarpit for nearly two centuries over the 
search for meaning and whether meaning has any meaning. Darwin 
came along and gave us the ability to factor God out of the equation 
of our existence by showing us to be part of the chance process of 
random mutation. Ever since, it seems many of us flounder to justify 
morality, justice, charity, grace. Without a belief that we are part 
of something greater than ourselves life becomes dark or blindly 
hedonistic. Without a belief that we are part of something greater 
that ourselves, why create art? What would be the intent? 


e If the intent is to make money, is it art or marketing and 
commerce? 


e If the intent is to become famous, is it art or simple vanity? 


e If the intent is to persuade or control, is it art or politics and 
the desire for power (which probably 
reduces to vanity)? 


It is important here to separate the 
ideas of process and intent. Both 
are necessary to create art and in 
good work they nicely enfold each 
other. Art that lacks intent, that is 
all about process, is not really about 
much at all. It unfolds itself with no 
significance. Conversely, a work filled 
with intent, but weak in process, is 
usually poorly crafted and will at 
best be misunderstood, and at worst 
completely undermine the intent. 
Artists compete with much in trying 
to engage an audience. A poor balance 
of process and intent creates a danger of boring an audience or 
developing within the audience a contempt for the artist or the art. 
The enterprise fails. Better to encourage walks in the woods and to 
let the synchronicities of nature sing to us. 


In the early 1950's, composers John Cage and Pierre Boulez 
followed opposing directions in using processes of chance versus 
rigorous choice in music composition. At this time (ca. 1951) they 
both wrote compositions that demonstrated their methods. Boulez 
wrote "Structures 1a" for piano, a piece credited by many as the 
first written with the process of total serialization. All the musical 
dimensions, pitch, rhythm, loudness, articulation, were controlled 
by a rigorous serial process. Total control of musical elements was 
achieved by a systematic, composer-imposed, rational method. 


On the other hand Cage's work, "Music of Changes” for two pianos, 
was written with chance operations. Using the | Ching, The Book 
of Changes, Cage sought to minimize the composer's involvement 
in the process by letting coin tosses make the musical decisions. 
Random process built the composition. 


Brian Evans--still from Limosa (2004) 


These two works were seen at the time as expressions of compositional 
processes at the extremes of the spectrum between chance and 
choice. Interestingly, on hearing the works, many listeners hear little 
difference in them. Total choice and total chance as compositional 
processes seem to join the ends of a line into a continuum. An intent 
of both composers in these pieces was to move beyond the history 
of Western tonal music, while using a tool (the piano) specifically 
designed to exploit the tonal music system. It's not surprising 
that the aural result of the two pieces is similar, even though the 
processes are diametrically opposed. The composers were both 
musically trained in, and their work informed by, traditional Western 
musical practice. Their starting points and desired destinations were 
similar. It was their processes that differed. 


A deeper aspect of these pieces had to do with the processes 
employed and the relationship of those processes to music history 
and Western history. The composers sought to navigate around 
references to Western tradition. This was the desire of many artists in 
the early 1950's, right after World War Il, the most recent testament 
to Western tradition. Chance 
as a tool, as a process, proved 
as effective as total choice. (It's 
interesting that both composers 
tempered the extremes of chance 
and choice in later compositions, 
both bringing in aspects of 
improvisation and indeterminacy.) 


Cage, from the early ‘50s 
throughout the rest of his 
compositional life, sought to 


remove himself (and Western 
thought) from the compositional 
process, yet the pieces were still his 
works, reflecting an intent beyond 
chance. He signed his name to the 
manuscripts, took a bow at their performance, and had very specific 
ideas on how they should be performed. 


Cage began the use of the / Ching around 1951, shortly after the 
publication of the Wilhelm/Baynes translation of the book. The 
forward to this edition was written by Carl Jung. In that forward 
Jung describes the random selection of an | Ching hexagram (and 
its accompanying description) as “an indicator of the essential 
situation prevailing in the moment of its origin." The hexagram 
chosen through a chance process is not only coincident in time but 
in "quality" with the moment of selection. 


Jung continues, "This assumption involves a certain curious principle 
that | have termed synchronicity, a concept that formulates a point 
of view diametrically opposed to that of causality. Since the latter 
is a merely statistical truth and not absolute, it is a sort of working 
hypothesis of how events evolve out of one another, whereas 
synchronicity takes the coincidence of events in space and time 
as meaning something more than mere chance, namely, a peculiar 
interdependence of objective events among themselves as well as 
with the subjective (psychic) states of the observer or observers." 
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There really is no such thing as a random event, only a context 
undiscovered. Foran event to be random it cannot exist in relationship 
to anything else. It is relative to nothing. From the old rationalist/ 
reductionist view (causality), this is, of course, impossible. Every 
event results directly from everything that has happened before. So 
much so that, in theory, everything is predictable, nothing is random. 
Questions of how the whole process got started, or where the 
natural laws come from, were of great importance to the founders 
of the reductionist view (Galileo, Kepler, Newton, et al). There was 
meaning to be found in all events as they, and we, were put into 
play by The Grand Designer as part of The Grand Design. When 
Darwin replaced the Grand Designer with random mutation, natural 
selection and non-teleological evolution, meaning became elusive. 
Yet the grand design was still there as a testament to something 
great, substantiated by the effectiveness of mathematics and the 
success of the industrial revolution. 


The causal perspective still prevails (without the baggage of purposeful 
design) but now the quantum view seems to more accurately describe 
what is really going on. In the face of much of its counterintuitive 
workings (at least to the Western mind), the onward rush of our 
technological development in the 
20th century (from atom bombs 
to microchips) seems to validate 
its truth. The quantum view takes 
causal certainty out of the game, at 
least with respect to what we can 
observe. There is something more 
going on. The stuff of matter is too 
fine, too subtle, not to be affected 
by our simple gaze. The act of our 
observation impacts the observed 
such that we can never truly know 
it. We are intimately involved with 
any reality that we are in. To that 
end, can there really be a random 
event, a random act? 


Brian Evans--still from Limosa (2004) 


Every event we observe, whether initiated by us or not, is informed 
by us. Everything we do exists in relation to, and is informed by, 
the total of our funded experience, previous action and quantum 
interdependence. So is there really such a thing as a chance act? 
The reductionist says no, because given initial conditions, they could 
have predicted it. The quantum realist says no, because our very 
participation in the act informs it, such that it is no longer random. 
In art, chance as intent is meaningless. To take the composer out 
of the composition, to take the painter out of the painting, negates 
the act. Even in Cage's famous silent work 4'33", his decisions frame 
the work and structure the experience. Chance as process has a 
long history. It began when the first person chose to document, to 
frame and structure, an aspect of themselves or their world in some 
creative way. Just as nature photographer Ansel Adams framed 
and structured his photographs. His work, it could be argued, was 
derived from chance operations. He pointed the camera, composed 
the frame, chose the moment. The result we see is a random event 
frozen in a moment of his choosing, a snow-crusted treeline, ice- 
cracked rockface, pendent moon. Is there a value in an Ansel Adams 
photograph that transcends the moment it captures? If not, then 
why bother with it when we can go to nature ourselves and have 
the experience first hand? 
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So are there really random events, chance occurrences? Or can 
randomness be attributed to our misunderstanding, misapprehending, 
or misinterpreting a context? The rationalist/reductionist has 
a clockwork context and a tacit belief in a watchmaker, blind 
or otherwise. Now, in our quantum reality, things can be seen 
differently. We live in a statistical world where a single event can 
seem random and meaningless, but when seen in the appropriate 
context, a meaning can be found. The act of observation informs 
the event, as does the complex interconnectedness of things. The 
devil is in the details, from the photons we focus with our gaze 
to the butterfly in Japan whose wing flutter causes an Oklahoma 
twister. But maybe "God is watching us from a distance." 


The Japanese haiku takes simple, seemingly random events, 
coincident only in time and/or place, and describes them--a chance 
meeting of poet and nature, frozen in synchronicity as a haiku 
moment. The poet simply documents the moment clearly and 
objectively. But there is a deep meaning to be found, a unity to be 
discovered between the observer and the observed. A chance event 
the poet has captured and that we can share. The haiku moment, a 
quantum reality unified somewhere beneath the surface of things. 


The butterfly, 
Resting upon the temple bell, 
Asleep. 


Buson (trans. R.H. Blyth) 


It's in that moment when we 
really sense ourselves as a part of 
something greater. It's what some 
might call an aesthetic experience. 
Chance as a process has great power 
to lead us into this moment, as it 
helps us to see beyond the surface 
of things. To resonate with a more 
subtle harmony, to grasp a hidden 
order. Chance as a process negates 
itself in intent. It provides meaning, the mother of knowledge. 


Art and life are different expressions, with different resonances, each 
capable of intensifying the other. Being in love, reading Romeo and 
Juliet, each is broadened, made more meaningful, by the other. High 
art can reach deep and with subtlety. However, if you consider life as 
fundamental to art, then maybe all art forms have a basis in chance 
processes, to the extent that we are but a manifestation of a series 
of seemingly random events, from the myriad accidents of life's 
primordial beginnings, throughout our evolutionary development, to 
the one-in-a-million chance of our individual conception. 


When looking at events in close view, we can miss the context (the 
proverbial trees versus the forest). Without a context of personal 
value, events are perceived as random, chance, by accident. They 
are devoid of meaning, and nihilism sets in. Trying to understand 
events beyond the sterility of process lead us to intent, a search 
for context and meaning. Perhaps the great reward to come from 
chance operations in art is the realization that below the surface of 
things there are no accidents, only meaning, something greater than 
ourselves, of which we are a part, waiting be known. 


tto://www.ghostartists.com 


ARTIST AS RESEARCHER: 
UNDERSTANDING THE TOOLS 


By Theresa Gartland-Jones 
Abstract 


The paper begins with a response to the nature of contemporary 
artists relationships to how computers have permeated the fine 
art domain and how they affect the creative process. How should 
artists utilize this tool in 
order to fully understand 
and explore its potential? 
Using the example of 
a recent project | have 
undertaken called ‘nGen’, | 
shall discuss some aspects 


of how the computer 
tool has influenced the 
process and creative 


ambitions. The conclusion 
will briefly summarise my 
future research and what 
is a relatively new and 
potentially rich avenue for 
artists. 


Creative Research 


Creativity in the visual arts 
is at a fascinating stage of 
development, because as 
an artist | have access to 
technology and innovative 
methods of modeling 
creative processes. | regard 
computers as both tools 
that enable the use of 


sophisticated software 
metaphors for visual °% 
language exploration, 


and as tools that offer the potential for artists to enter into a 
world of research in which they can influence the metaphors. 
Computational processes and technology have generated new forms 
of visual aesthetic and interaction, within both a modernist and 
deconstruction art practice as discussed by Stephen Wilson who 
asks the question: 


Can the Arts Offer Alternatives in Setting Research Agendas, 
Interpreting Results, and Communicating Findings? [1] 


The answer is yes, and Wilson highlights the independent nature 
of the artist as researcher, valuable commentator and originator of 
ideas. In order for the artist to reach this stage, they have to be open 
to science, technology and the arts in order to be transformational in 
their creative practice. It seems a natural progression for artists such 
as Paul Brown or Manfred Mohr to explore the multiple permeations 
possible with the systemization achievable through computer 


methodology. However, much computer art is not defined by the 
artist, it is mediated through the scientist, or the artist has a playful, 
passive, collaborative relationship with technology. It is important 
that if artists are going to engage with new technology and the 
impact on their aesthetic, or formal codifying of their creative 
process, then it is necessary to take on the work that is required to 
make the relationship a symbiotic one. 


Figure 1. This is a still from nGen showing the performers and projected animation. Audio and visuals can be viewed at: www.atg). 


nGen: Collaborative (music and fine art) Installation 

My art practice and interest in the science of autonomous systems 
and evolving dynamic forms has become a visual theme in my 
work and the focus of my research. | have a personal creative, 
modernist history of exploring the human form and this ontology 
now incorporates visual ideas for representing current research into 
modes of information processing in the human brain, how these are 
modeled, and how they are applied in a creative context. Although | 
do not fully understand these mechanisms, it is the isotropic nature 
of this connectivity that holds a fascination for me, both in terms 
of how to represent, visually, the potential of these ideas whilst also 
considering them in relation to human memory, communication and 
creativity. Trying to understand the key to creativity and information 
processing feeds into my work through both the philosophy and 
scientific research into processes utilized to model them. 
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Figure 2, Video stills from the nGen imaging. Audio and visuals can be viewed at: 
www.atgj.org. 


The project nGen explored visually how to represent a continuum 
of matter and time conveyed through time-based interactive 
processes. Traditional drawings were made and then manipulated 
and computer animated using morphing software, Photoshop, and 
Flash. These were brought into Director and presented as a projector 
(see fig.1). The work had no set linear timeline, because it is the 
potential for interaction and non-linear narrative that initially 
engaged me in using the computer as a tool in my art practice. The 
interaction is designed as a multi-user environment, creating a two- 
way dependency on the relationship between the audience and the 
visual and musical narratives that are generated. 
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The real-time correspondence between the audience, visuals and 
music, was dependent on the nature of the audience interaction. The 
visuals and music were mapped to sixteen virtual zones that were 
resolved by 8 sensors that detected the movement of the audience. 
Each zone contained a family of images and musical phrases, so 
that the virtual zones equated to a synchronized transition from 
disorder to harmony. Essentially, | was controlling the individual and 
group narrative, by being aware of how the elements came together 
and at what point. However, for the audience, the synchronicity and 
dynamic feel of a work evolving over time and their influence on it 
were important elements that | hoped they would experience. 


The interactivity was programmed using Lingo in Macromedia 
Director, a time-based software. Director has the versatility of Xtras 
that allow for hardware device interfaces. We used the |-Cube 
system for translating the sensor output into midi data, which 
is then read into Director via a midi Xtra. For audio, Director is 
limited in its facility to have multiple synchronized channels 
operating, so software had to be written in order to handle the 
music generation. 


The project collaboration was with composer Andrew Gartland- 
Jones who employed processes he termed as ‘Organic Music’ He used 
computer technology to ‘grow’ musical phrases through the use of 
what computer scientists call Genetic Algorithms. The phrases are 
then played on real instruments and recorded. The music therefore 
explores the creative interplay between humans and machines, 
with the final realized composition seen as collaboration between 
Andrew, the computer program, the visual narrative and the way 
the audience react within the virtual space. 


As part of the installation, we included live music performance. 
The role of the musicians was twofold. They improvised in response 
to the audience who stimulated music generated through their 
interaction with the sensors, and, they also read computer-generated 
phrases that were scored by Andrew. The performance element had 
an unforeseen, but welcome effect on the nature of the audience 
interactivity, because they became much more confident in their 
exploration of the work and perceiving the subtleties within. 


Current and Future Work 


For me, current and future work has moved on to researching 
intelligent systems that, in the words of Ernst Edmonds: extend 
the method to unify interactive work and, with the help of meta- 
rules, interactive work that performs differently over time according 
to experience. As the artwork learns, it changes the way that it 
develops rather than simply the way that it employs stimulus- 
response rules. [2] 
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INTELLIGENT INTERACTION: 
COMPOSING MUSIC WITH BUILDING BLOCKS 


by Andrew Gartland-Jones 
What Is The MusicBlox Project? 


The MusicBlox project is about using blocks, similar in size and 
shape to children's wooden building blocks, which are combined 
together in a similar way to make physical structures. However, 
each block has the ability to play and compose music, so 
building a physical structure results in creating a piece of music. 


Imagine you haveasingle block. You giveitasmall musical fragment (its 
‘home’ music), putit on the table and start it off playing. The block then 
begins repeating its musical phrase, eithersporadically orcontinuously. 


Make another block, this time with a different piece of ‘home’ music. 
Place it next to the first block and they start playing together, and 
in synch. Now press a button on block 1 labelled ‘send music’ This 
causes block 1 to send its music to block 2. Block 2 then performs a 
composition activity, based on its own ‘home” music, and the music 
it has just been passed by block 1. 


The compositional aim for the block is to produce a new musical 
section that has a thematic relationship with both its home music 
and the music it has just been passed. Block 2 then starts playing 
its new music. 


Now imagine a chain or group of several blocks in any 3D structure. 
All blocks have a ‘send music’ button, so the start of the chain does 
not have to be block 1. If a block is passed some music it recomposes 
itself, then passes its new music on to all of its neighbours. 


Block 1 sends its music to Block 2 >> Block 2 re-composes itself. 
Block 2 sends its new music to Block 3 >> Block 3 re-composes 
itself. 

Block 3 sends its new music to Block 4 >> Block 4 re-composes 
itself. Etc... 


By sending out music from a starting point all other blocks within a 
specified range recompose, and the collective music of the structure 
is transformed. It is important to clarify that each block holds onto 
its ‘home’ music throughout, enabling any music composed by it 
to remain thematically related, despite the constant process of re- 
composition each block undertakes. In this way the composer of the 
home music for all blocks maintains a compositional thumbprint on 
the evolving musical structure. 


The development of the overall piece of music will therefore be 
determined by: 


1. The design of the composition system described here 

2. The nature of the music imported as ‘home’ music into each 
block 

3. How the blocks are built into structures 

4. How these structures change over time 

5. How the user sends music around the structure 


In effect the listener/performer is able to shape the overall music by 
choosing to send musical fragments from blocks they like to influence 
other blocks. One part of the structure may have composed some 
ideas the user likes. A block from that group could then be placed in 
another part of the structure to see what effect it has. 


Currently the project exists as a working 3D graphical prototype, 
see fig 1 below, with plans to develop the hardware model during 
2003. 


Musical Aims 


In terms of my previous work, MusicBlox can be seen as continuing 
an interest in exploring the shifting relationship between the roles 
of composer, performer, and listener. 


Western musical practice in the 20th Century progressed in 
two opposite directions with regard to such relationships. Many 
composers, especially those connected with post 1945 avant-garde, 
(e.g. Webern, Bartok, Boulez), chose to provide increased specification 
on musical performance, by providing dynamic articulations on 
every note for example. The effect of this is to subtract from the 
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opportunity for creative interpretation by the performer. Other 
composers released control, making scores less specific. The chance 
elements and graphic scores of John Cage (e.g. Fontana Mix, 1960), 
and the aleatoric music of Lutoslawski (e.g. Venetian Games, 1961), 
are examples of this relaxation, providing performers with a greater 
degree of creative freedom. Aside from Cage's 4' 33" however, where 
the audience are also the performers, this still leaves listeners with 
little or no control. 


My work before MusicBlox centred on interactive music. In 
effect what this usually consisted of was pre-composed musical 
fragments, sometimes sounds, sometimes synchronised loops, that 
were combined in real-time under the control of some kind of a 
user interface, such as ultrasound sensors, light sensors, etc. This 
undoubtedly shifts the creative balance, allowing the listener a 
higher degree of involvement in the realised piece, but | was unhappy 
with the limited depth of musical exploration enabled by common 
sensing mechanisms, and the high degree of predefinition inherent 
when using pre-composed fragments. 


| am aware of other projects using building blocks as a metaphor 
for building musical structures, such as the Sony Block Jam project 
[1]. Although these overcome to 
various degrees the limitations 
found in using common sensor 
interfaces, we are still left with 
musical predefinition, and the real 
interest for me lays in the process 
of ongoing (re)composition each 
block undertakes. 


By considering the limitations of 
predefined music | was led to a 
conception of the compositional 
actas being the process of defining 
a search space’ for exploration by 


search space (or conceptual space) defined for the non-composer. 
Highly specified scores allow a very restrictive search space for 
creative interpretation. Further along the continuum, graphic scores 
increase the space available to a performer. So what | was looking 
for was a way to define a search space that is wider than a limited 
set of pre-composed fragments, perhaps to provide a guide through 
that space, and to create a mechanism for this space to be explored 
by the performer/listener. 


It would be a composing system, rather than playback system, with 
an interface that encouraged depth of involvement, and would 
provide the performer/listener with a high degree of creative 
influence on the actual realisation, but would also still enable a 
composer's thumbprint to be present. This relates the work of Cope 
[3], as the ‘thumbprint’ | describe could easily be seen as musical 
‘style’, but what | needed was not a way of recreating style, but of 
playing with parameters of style, and using it as a compositional 
influence on a new piece. 


How Do The Blocks Compose 
Many mechanisms have been employed in the task of algorithmic 


composition, from the stochastic 
processes utilised in (possibly) 


the performer and/or listener. This 
is an extension of the notion of 
the act of composition itself being 
an exploration of the potentially 
very large search space permitted 
by the compositional practice of 
the composer, even considering 
limitations of instruments, styles, genres etc. | was now regarding 
this exploration as a two-stage process. Firstly the composer limits 
the larger search space by defining an area within it. Secondly the 
performer or listener explores this more limited space and defines 
his or her own aural realisation within it. 


aera tho # 7 created 


Another way of looking at this is to see the combined input of 
composer and system designer as mapping out an area within what 
Boden [2] refers to as a conceptual space, which is defined as “an 
accepted style of thinking in a particular domain”. This conceptual 
space maybe already in existence, or could be a new addition to the 
domain; in Boden's terms, the input from the composer and system 
designer then maybe either E-Creative (exploratory creativity) or T- 
Creative (transformational creativity). The user is asked to explore 
that space and is therefore performing potentially combinational, 
and/or exploratory-transformational creativity. 


The degree of control relinquished or retained by the composer can 
be seen as points on a continuum reflecting the size of the limited 
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Fig. 1. This screenshot shows the current functional 3D graphical 


oj fm the earliest example of computer 
tt Pie generated composition: The Illiac 
ocx commen Suite 1955 [4], to the more recent 
et ce application of cellular automata 
_wacomeon | _ suiba> by composers such as Miranda 
ea nas [5]. | decided to focus on the 
pe] ne use of a Genetic Algorithm? (GA) 
ee model in the composition system 
rece comme for two reasons: the increased 
ccc use of GA's in generative artistic 
=a systems, and the resonance the 
ee simple GA model created with 
= PR RDERE I= at least part of the processes 
Fest Ran ft tre Pt used in my own (non-generative) 
compositional practice. For a 

Ovo twsages _ Sm useful overview of work on GA's 


and musical composition see 
Burton and Vladimirova [6]. For a 
more detailed description of the 
developed algorithm see Gartland-Jones [7]. 


Resonance Of The Simple GA Model 


A commonly used compositional process may be described as taking 
an existing musical idea and changing it in some way. Musicians in 
various styles and genres may follow the process differently, some 
through improvisation, others through pencil and paper, but what is 
most often practiced is taking an existing idea and mutating it to 
provide a new idea. In fact mutation is closely related to notions of 
development, which lie at the heart of western musical concepts of 
form and structure. It may even be possible to see development as 
directed mutation. 


In this model of [idea - mutation - new idea] we see three aspects to 
the creative act: creating/selecting the initial starting idea, mutation 
processes, and assessment of the results of mutation. With the core 
elements of GA's being mutation (including cross-over) and fitness 
assessment there appears to be a strong correlation with at least 


some aspects of the ‘human’ process of generating musical material. 
The degree of any similarity is likely to be in part determined by the 
nature of the mutation and selection processes. 


We do not, of course, escape any conceptual difficulties related to 
artificial creativity by using this model. The similarity of process does 
suggest however, that GA's might be a good starting point. 


What And Who Is MusicBlox Designed For? 


MusicBlox is designed to be used in two modes: As a free exploration 
tool, by which | mean it is free enough to make ‘mistakes’ and 
explore some farther regions of the search space, and as a real- 
time performance ‘instrument, during which it needs to be a little 
more restricted in terms of the allowed musical path. | see them 
being used by musicians wanting to explore themes and ideas, and 
by anyone wanting shape to music they hear. 


The system is able to display scores of what the blocks are 
composing, and the aim later in 2003 is to perform live with the 
system controlling a number of real instrumentalists. 
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Footnotes 


‘| am using the term search space here to mean all permitted options 
resulting in all permitted musical end results. In effect it is not as 
open as the common example of a group of monkeys randomly typing 
at keyboards that, given an infinite amount of time, will eventually 
produce the complete works of Shakespeare. In this example the 
search space is not restricted beyond random key strokes, where as 
in fact most examples of literature, at least the ones | enjoy reading, 
are likely to occupy a smaller subset of such a large random space, 
being limited by the language, grammar, historical style, personal 
style etc. 


? A Genetic Algorithm is a computer search technique, which derives 
its behavior from some of the mechanisms found in biological 
evolution. This is done by the creation in a computer of a population 
of individuals represented by chromosomes, in a similar way to the 


chromosomes that we see in our own DNA. The individuals in the 
population undergo a process of simulated ‘evolution’, including 
mutation, crossover, and selection, in order to evolve a solution the 
problem in hand. 


Contact: 


(please note: Andrew passed on shortly after this paper was written. 
Our best wishes and sympathy go to his wife and creative partner, 
Theresa Gartland-Jones. Contact can be made through their 
website: 

http://www.atgj.org 


An Image from the “Evolve” Installation by Andrew Gartland-Jones 


A sound and image Installation. This work involved activating groups of sounds and 
images/video using i-cube system. As the audience interacted with the work, their 
presence continually altered the light, and as a consequence the narrative of the 
piece changed. 


Iv] 
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522,629,966,200,000,000 years. 
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Figure 1: An example of active window of the Real Kecak System 
1. Introduction 


The "Real Kecak System" is interactive computer music in which 
polyrhythms correspond to any combination of real numbers. In 
this work, it was my main aim to innovate musical form through 
recursive structures of any irrational numbers. No random numbers 
or stochastic processes were used in this work, which was based on 
the quite deterministic laws of mathematics. 


Nevertheless we realize that there are innumerable types of musical 
forms with this work. The real numbers are infinite; musical forms 
are infinite! We can touch an eternity for a brief space of time. 


2. Origin and Development 


When | came to know the Penrose Tiling in 1983, | was inspired 
that it was nothing less than the architectural form | had been 
looking for. | have studied the general quasi-periodic structure since 
then. As a result, | have become acquainted with hyper-dimensional 
geometry. 


When | came to know the Fibonacci Sequence in 1986, | was also 
inspired that it was nothing less than the musical form | had been 
looking for. | immediately played the sequence as a musical rhythm, 
and | designed standard staircase called the Democracy Steps [1]. 


| have created various quasi-periodic works as arts based on tempo 
and space in parallel with scientific research [2]. The pattern 
generated by the recursive structure of any irrational number is 
called a quasi-periodicity, which is neither periodic nor random. It 
has a very strong relation with Fractal and Chaos Geometry. It is 
my belief that the Golden Mean is the simplest and most pregnant 
quasi-periodic structure. In other words, the Golden Mean is the 
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simplest fractal generator. 


In 1991, | published an original paper in Japanese describing a 
musical theory that integrates rhythm, scale, and tone using the 
self-similitude of the Golden Mean [3]. From this viewpoint, any 


| existing musical forms are too finite. 


When | participated in the international Bamboo Congress 1995 
in Bali, | watched an Indonesian polyrhythm performance. This 
experience allowed me to compose a new piece making use of my 
musical theory. This is the Fibonacci Kecak [4]. 


The Real Kecak System is a general extension of the Fibonacci 
Kecak. It is interactive computer music. First, | wrote the program in 
N88Basic in 1999; then, | rewrote it in MAX for Macintosh in 2000 


[5]. 


3. Mathematical Principle 


Initial sequence AB /1 
ence ABA 2 
A \E 2/3 
A ABA 3/5 
A ABAABAAB 5/8 
A ,BAABAABABAABABA 8/1 
Leecri = 
i sequence BA 1+ 
1 seque Ba l 
que 3 
1 seque 
1 sequ 1 
Figure 2: General Extension of the Fibonacci Sequence [6] 
3.1. Extension of the Fibonacci Sequence. It was well known 


that the Fibonacci Sequence was generated by the line whose 
tangent was the golden mean on the 2D coordinate lattice as shown 
in Fig. 2(b). 


In 1992, | published that such a sequence of letters could be extended 
to any real number as shown on Fig.2 [6]. The example (a) is 1/1, 
the example (c) is 2/3. Generally any rational number generates the 
periodic sequence of letters. The period is the sum of the numerator 
and the denominator of the fraction, e.g. in case of Fig.2(c); the 
sequence of letters repeats every 5 letters. 


If the tangent is an irrational number, the sequence will never 
repeat. 


| suggest that such a general sequence of letters should be called a 
"Real Sequence”. 


3.2. Substitution and Convergence. In the mean time, it is well 
known that there is another method to get the Fibonacci Sequence 
with the following algorithm. 


Initial sequence is "AB". 
Transform "A" to "AB" and “B" to "A". 
Then we get 2" sequence "ABA" Transform again by the same way. 


Then we get 3 sequence "ABAAB". Go ahead. 
4" sequence is "ABAABABA’. 
And so on... 


| realized that the above algorithm corresponded to the hierarchy 
of convergences derived from the continued fraction of the Golden 
Mean 0.61803339.... 


The numeral of the denominator is number of letters "A". 
The numeral of the numerator is number of letters "B". Everything is 
the Fibonacci number. 


Self-similitude of the Golden Mean is represented on the above 
schema exhaustively. | substituted sound for letters of each sequence. 
So to speak, the music was rhythmic counterpoint. We can enjoy 
the phantasmagoric moiré of rhythm patterns. | believe that there 
had never before been such a successful use of the Golden Mean in 
music.. 


This is the principle of the Fibonacci Kecak (1995). 


3.3. Extension of the Fibonacci Kecak. On the other hand, any real 
number has its own hierarchy of the convergences derived from a 
continued fraction. Each convergence has its own periodic sequence 
derived from the Real Sequence as | defined above. Therefore the 
Fibonacci Kecak can also be extended to any real number. The Real 
Kecak System plays polyrhythm music consisting of these sequences 
of convergences. We can exhaustively make the best use of the self- 
similitude of irrational numbers for music. Our ears can recognize 
the characters of real numbers. 


Since the number of real numbers is infinite, there are endless kinds 
of musical forms. Since most of the real numbers are irrational 
numbers, most of the music made should be non-periodic and 
eternal. 


This is the principle of the Real Kecak System. We can substitute 
anything into "A" and "B". 


4. Manual of the Real Kecak System 


You can input any real number. The Real Kecak System will display 
its expansion into continued fractions and convergences based on 
the Euclidean Algorithm [7]. Each n-th convergence corresponds to 
a planet in the Real Kecak System. Each planet plays their unique 
rhythm. The circumference of the orbit represents the period of the 
rhythm pattern. 


When you input an integer or rational number, you hear a simple 
periodic rhythm. It is so simple that you should be tired of it soon. 
Such a system has very few planets. 


On the other hand, when you input an irrational number, e.g., SOR2, 
SOR3, or EXP1, the music is fantastic, and we do not get tired of 
it. The musical texture goes on changing little by little beyond the 
astronomical period. We enjoy it as ethnic music. 


5. Fibonacci Kecak 


If the Golden Mean (1.6180339... or 0.618034...) is entered, the Real 
Kecak System plays the Fibonacci Kecak. The system has the most 
number of planets, because approximating the Golden Mean using 
fractions is more difficult than approximating any other irrational 
number. In other words, in the case of the Fibonacci Kecak System, 
there is rarely conjunction. 


What follows is the calculation of the length of time during which 
the Fibonacci Kecak can keep changing. We can get the solution by 
calculation the L.C.M. of the following Fibonacci numbers. 


23 5 8 13 21 34 55 89 144 233 377 610 987 1597 2584 
4181 6765 


If each beat is 150 milliseconds long, the music piece will not be 
repeated for 522,629,966,200,000,000 years. 


Most astronomers consider that our universe is 15 billion years old. 
We need 35 million times the life of our universe to listen to an 
entire piece of music. This length of time is not easy for humans to 
grasp. But we should not say that it is not realistic. 


On the other hand, if a single-digit integer is entered, the music 
is repeated in just a few seconds. Most people find the Fibonacci 
Kecak very exciting, i-e., the Real Kecak System evidences that the 
Golden Mean is the critical real number. Although it is the simplest 
structure, it generates the most diverse gestalt. That is why Nature 
very often uses the Golden Mean. Therefore, | also use the Golden 
Mean actively for artistic purposes. 


So to speak, the Real Kecak System is a typical fruit created by 
Pythagoras being equipped with an Ouroboros Engine. 


6. Installation with lights 


In 2001, | created an installation called “Stern-warte" [8] in Tokyo 
as shown in Figure 3. | built a maze based on the Penrose Tiling all 
over the floor. People could walk between the pentagonal mounds 
of sand as if they were ants. This work was an experimental city 
design. | installed lamps over each pentagonal mound. They twinkled 
diversely being synchronized with the sound of the Fibonacci Kecak. 
A computer controlled both sound and light. 


The architectural form is completely homologous with the musical 
form. Architecture and music were elegantly integrated in a common 
space and time. | believe that it was a completely novel experience 
for the visitors. The installation is not there now, but | would like to 
build such a space as a permanent sculpture in the near future. 


7. Concert and Workshop 


The Real Kecak System can be played as instrumental music. | 
established a percussion ensemble called "ENSEMBLE STARCAGE" 
with my friends. Sometimes, | held workshops to instruct children on 
the Real Kecak using bamboo sticks. They enjoyed it very much. 
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Figure 3: Stern-warte Installation 


Furthermore, | try to use this system to help schizophrenic patients 
during their psychoanalytical treatment [9]. 


Currently, some Japanese professional musicians are using my 
musical theory: Mr. Chiharu Wakabayashi, Ms. Tamami Tono, Mr. 
Takeshi lsogai (Ubartmar), and Ms. Naoko Maeda. Once | rewrote a 
score on paper, then | made several concerts with Tamami Tono who 
plays the SHO which is a Japanese traditional bamboo flute. 
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AN INTERVIEVV WITH MAX MATHEWS 


by Loren Means 


LM: John Chowning told me that your Radio Baton was the very 
latest in computer sound controllers. 


MM: He's very generous in saying that. The Radio Baton was a fairly 
early controller of this kind. I've 
been working on it since the mid- 
Eighties. But now, there are lots 
of different kinds of controllers. 
In fact, we teach a course called 
HCI, Human-Computer Interface, 
where we train music students- 
sometimes they have engineering 
skills, sometimes not-to make 
their own controllers, to make 
their own electronic music 
instruments. Going down to the 
Radio Shack and other stores 
and buying standard components 
and putting them together. The 
students use a patch field. You 
can plug resisters into it, you 
don't have to solder things. 


Here's a picture of me and the old 
Radio Baton. These are the two 
batons, and you wave those in the 
air above this receiving antenna, 
this plate here. The antennas and 
the electronics track the motions 
of these two batons in three- 
dimensional space. X is top to 
bottom, Y is side to side, and Z is 
the height. So that's worked quite 
well, and there are a number of 
expressive compositions for this. 
The idea is to make a device 
where the electronic musician 
can perform more expressively 
than with a traditional keyboard. 
Anyway, this has been around for 
ten years or so. When it was made, 
it was necessary to put wires to 
the batons to connect them to the electronics box. That's not very 
pleasant to have wires, so I've been working on a wireless model, 
and | have a prototype of the wireless baton. Instead of having the 
oscillator-the radio transmitter, if you will-in the box and a wire 
taking it to the transmitting antenna, the oscillator is now in the 
baton. So this is all wireless. 


The old version of the antenna is complicated, with wedges. The 
strength of the signal depends on how thick the wedge is under 
the transmitter. There's a thick wedge at one end, and next to it a 
complimentary wedge with the other end thick. So by comparing 
the strength of these two signals, the computer can tell where it is 
in X. There are some bars that tell where it is in Y, and a different 
technique for Z. The program that makes the music is in my laptop. 
The Radio Baton is actually a MIDI controller. So there's a MIDI 


Figure 1. Max Mathews and the Radio Baton. 


interface. You know MIDI, | assume? 


LM: MIDI is basically a universal protocol for connecting computers 
to other devices. 


MM: That's precisely what it is. The X-Y signals are encoded in 
MIDI. They go into the box, and hence by 
the universal serial port cable into the 
computer. Then the computer sends out 
commands to a Roland synthesizer to 
play music. The model for this particular 
device is an orchestra conductor. The 
orchestra conductor waves batons, and 
if not controls, at least influences the 
orchestra. And presumably, he controls 
the expression of the music. But he 
doesn't have to play the notes. They're on 
the music paper, and the poor musicians 
have to do all the expertise of getting the 
right notes. Here, the score of the music 
is in the computer memory, and with the 
one baton, I'm going to beat time, like 
the conductor does, to set the tempo. 
With the other baton, I'll use X and Y 
or some combination of these things to 
control the loudness and the balance 
of the voices in the orchestra. There 
are 127 different timbres in the sample 
synthesizer. Really they're samples of the 
127 different instruments. So sending 
a number to the synthesizer from 0 to 
127 will select an instrument for a given 
channel. There are sixteen channels, so 
you have a sixteen-voice orchestra. 


| often demonstrate with a Rachmaninov 
“Vocalise," which | once played with 
Theramin's daughter. Chowning invited 
Theramin to come over here, about 
a decade ago. Theramin was in his 
nineties, but he was still very bouncy. He 
brought one of his daughters with him, 
as well as someone from the Russian 
music academy, a Communist who was 
keeping his eye on the situation. We had a good time. This "Vocalise" 
has a solo part which can be done with a number of instruments, say 
with soprano. Theramin's daughter did it on a theramin, and | played 
the accompaniment. My instrument, in many ways, is a grandchild of 
the theramin, since they both work in radio frequencies. As a matter 
of fact, they fought each other when we did the concert. Although 
they don't use the same frequencies, the theramin had such a strong 
radio signal that it saturated my input amplifiers, so that | couldn't 
play when the theramin was playing, if the instruments were too 
close to each other. So we had to move to the opposite ends of the 
stage, | on one side and the theramin on the other side. But there 
is one difference between these two instruments. That is that the 
theramin is the world's most difficult instrument to learn how to 
play. In fact, very few people have done a decent job of playing 
it. In this country, Clara Rockmore was the person who became a 
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theramin expert. | think she's still alive, actually, in New York City. 
And the Radio Baton is the world's easiest instrument to learn to play, 
because the conductor program does all the technically hard work 
for you, like getting the right notes. You still have to be musically 
adept to get the expression you want, make it expressive music, but 
that's the important and fun part of music, in my opinion. 


Computer music started in 1957, the first piece that was synthesized 
on a computer, which | did on an IBM 7094. The computer was on 
Madison Avenue in New York City. There were only two of them in 
the world at that time, one in Poughkeepsie in their research lab, and 
this commercial one there. | worked for Bell Telephone Laboratories. 
| was in their Acoustic Research Department. | made a gadget to 
digitize speech and put it into a computer, so that we could simply 
write a computer program to try for encoding speech, compressing 
it so that you could get more 
voices over the Transatlantic Cable. 
Instead of spending literally years 
in building a fancy speech coder, 
we could spend maybe a month or 
so writing a program to do that. 
So we would digitize the speech 
and put it through this program, 
and then put it through a Digital- 
to-Analog converter at the other 
end, and listen to it to see what 
the quality and understandability 
of the speech was. This actually 
turned out to be a very successful 
research device, and has led to some 
remarkable encodings for both 
speech and music. And, of course, 
nowdays it isn't just a research 
tool, it's the way almost all speech 
is transmitted around the world, in 
a digital form. 


| worked for John Pierce, who died 
a few years ago. He was probably 
the world's most famous engineer. 
The main thing he did was to 
invent satellite communication, or 
show that satellites could be used 
for communication. He was very interested in music. We were at 
a concert together, and we liked some of it and didn't like other 
parts of it. In the intermission, we turned to each other and said, 
"The computer could do better than this." And so he said to me, 
“Maxwell, | know you're supposed to be working on telephones, but 
take a little time on the side and write a computer program-you've 
already made the equipment to get computer numbers converted 
to sound-let's see what you can get out of it in the way of music." 
So that got me started in the music direction, and, of course, music 
has always been one of my great interests. | still play the violin, and 
enjoy it very much, although I'm not a good violin player. Probably if 
| were a better violin player, | wouldn't have bothered with computer 
music. 


| wrote five music programs, Music | through Music V, of which 
the first one was horrible, and the last one is still the pattern for 
almost all the so-called "studio" music that is made. When | say 
“studio music," in the beginning, computers were very weak and 
slow compared to the demands of making sound and music. In other 


20 : YLEM JOURNAL - Spring 2005 


words, it might take an hour to make a minute's worth of music. So 
there was no possibility of performing with a computer. You made 
a tape, and then played the tape back for the performance. And you 
could have the computer compute all night on the tape, and then 
you could play it back the next day. And that was fine, because in 
those days a composer might compose a piece, and then he'd wait 
ten years to get an orchestra to play it. So now, he could at least 
hear it. 


Then along about the mid-1980s, the technology got much, much 
more powerful. The first power was shown in special-purpose chips, 
of which John Chowning's FM chip is a very fine example. So that not 
only did it become much less expensive to own a digital synthesizing 
device, but it also was possible now to synthesize sound in real 
time. The DX-7 is the example that the Yamaha company made, 


Figure 2. The Entire Groove System Studio 


that was a very, very successful machine. One of the reasons was 
simply economic. An entry-level computer music system, using the 
computers that were available in the Seventies--and these were 
mostly DEC computers, the PDP-11was a very popular instrument for 
lots of things-the entry-level cost was about a hundred thousand 
dollars to get a decent system. So some universities could afford 
this, but most people couldn't. When Yamaha made their FM chip 
set, the cost of a DX-7 was about two thousand dollars. So overnight 
the price came down by a factor of fifty to one, and the number of 
people who really wanted to use this increased not by fifty to one, 
but maybe five thousand or a hundred thousand to one. It swept the 
world, primarily in the popular music domain. Electronic music hasn't 
changed the San Francisco Symphony very much. They occasionally 
have an electronic instrument in one of their pieces, but not often. 


Nowadays, computers, and even small computers, laptops, have 
gotten so powerful that you can do everything in one of them. 
So you can take a laptop on the stage and actually generate the 
numbers that get converted to the sounds, and do it all in real time, 


Figure 3. The GROOVE system 


and play it like a violin, or play it in the same live manner that you 
play the violin. It ain't like a violin, it's whatever you make. And 
whatever you make is mostly the controller, and then the program 
that you have in the computer. 


LM: Where are you teaching the class, teaching people to make 
instruments? 


MM: That's down at Stanford. Music 
250A. 


LM: You started at Bell Labs as an engineer, 
working on voice. 


MM: That's right, I'm an engineer, really. 
I'm not a musician. 


LM: But you have written 
compositions over the years. 


some 


MM: Yes, | have. One of my compositions 
is called "Slider." You know about twelve- 
tone music? The idea there is to use all the 
twelve tones equally, and arrange things 
so that no one hears a sense of tonality 
anywhere in the music. At least, this is one 
very pure form of twelve-tone music. 


LM: You don't repeat any note until you've 
played all the others. 


MM: Yeah. You do whatever is necessary to keep the listener from 
believing "Ah, that's the key of C." | wanted to carry this to the 
ultimate step. | not only wanted to remove all tonality, | wanted to 
remove all scales, so that there is no C or D or Eb or anything like 
that, that's recognizable in the music. At the same time, | wanted a 
strong sense of pitch in the music. So, there are two ways of doing 
it. One is, you can use narrow-band random noise. Provided you 
don't make the bands too narrow, you don't have a good sense of 
pitch, but you can convey a broad sense of pitch that way. But | also 
wanted to get some very narrow sense of pitch, so | made a piece 
that is made up entirely of glissandos. Now | have eliminated the 
scale completely, or | think | have. You can decide for yourself what 
you think. This was a piece | did in about 1966. It's composed with a 
graphic score. No notes or anything like that, just a bunch of graphs. 
To compose the thing, you draw a function. You can either draw it 
with a pencil and paper, or we had a light pen on a scope that we 
could draw with, that was directly attached to the computer. You 
can indicate note durations by dashes, amplitudes with accents, for 
example, by another line. That was the structure of this piece. 


LM: Was the piece realized in real time? 


MM: No, that was not realized in real time. That was in the mid- 
1960s. The computers just weren't quite fast enough to do that 
then. So you can draw the score on this computer scope, but you 
had to wait. The first real-time system was a hybrid system which 
had a digital computer producing control functions, and then had an 
analog synthesizer, sort of a mongrel-type synthesizer, which had a 
bunch of Moog modules and a bunch of laboratory oscillators and a 
bunch of things we built. The computer sent fourteen analog signals 
that came from fourteen Digital-to-Analog converters to the analog 
devices, and then you could control that. 


This was at Bell Labs, and it was in the late 1960s and early 1970s. 
There are some Moog voltage-control filters. There's some Moog 
voltage-controlled amplifiers for attacks and decays, and there are 
some laboratory oscillators, and then there's a rack where we could 
build cards out of op amps and other sound generators and plug 


ta 
Figure 4. Max Mathews using the GROOVE system. 
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Figure 5. [DX7CHIP]. The DX-7 FM chip. 


them in. And then there's a patch panel where we could connect 
everything together. So when the composer got going at it, each 
composer could have his own patch field. A composer came in at 
night when other people weren't using the computer, and he could 
patch that together. There was nothing very interesting about the 
computer itself. It had a keyboard. You could only press one key at 
a time, though. And some buttons. But the really interesting control 
device was this three-dimensional wand that you can just see behind 
me. This is the baton. 


LM: This is when you were using the GROOVE system [Generated 
Real-time Output Operations on Voltage-controlled Equipment]? 


MM: Yeah. This is the GROOVE system. You can move this wand in 
three dimensions: up and down, and back and forth. So you could 
control, for example, loudness with one dimension, and | used timbre 
for another dimension, and maybe the third dimension for pitch. And 
in fact, there's a piece that | made on that system. Do you remember 
Lillian Schwartz? 


LM: Sure. She was one of the original YLEM members. 


MM: She made the visual part of this piece. She did sixteen 
millimeter film mostly. | had the visual part converted into a DVD. 
This was a piece Lillian did called “Papillon” But she has a problem, 
and | don't know what to do about it. She gave her collection of 
art, sculpture and everything, to the Ohio State University Archives. 
And now she can't get ahold of any of the things. She would like 
to have the sixteen millimeter films converted to DVDs, and so I've 
written letters saying "She wants this, can you do it? I'd be happy 
to pay for it." So far | haven't heard that they're willing to let us 
do it. So be warned: don't give your things to archives until you're 
dead! My copy of “Papillon”, the visual quality is very poor, but the 
sound quality is quite good. The way | did it, it was an improvisation, 
where | just simply watched the film and controlled the sound with 
that three-dimensional wand. It was all done in one night, with the 
GROOVE system. 
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LM: Essentially, it's one voice and you're playing with 
the timbre. 


MM: That's right. It's just one voice. It was one timbre 
axis and one loudness axis, and one pitch access. This 
does have a scale built into it. The duration of a note 
was just how long you held the rod in one position 
until you switched to another pitch, and that marked 
the end of the note and the beginning of the next one. 
There were no rests. It's continuous in that sense. 


hd 
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LM: It's like the person never has to take a breath. 


MM: That's right. The timbre control was a rectangular 
wave form, and the X dimension was controlling the 
factor of the waveform, so the right was a square 
wave and the left was a narrow pulse wave. It was 
quite effective. The thing that | most want to get, 
and | think Lillian most wants to get, is the film either 
“Running Man" or “The Olympiad” “The Olympiad” is 
actually the correct name for it. | have a still image 
from it. She based that film on this Englishman who 
in the 1800s figured out how to take pictures of 
running horses... 


LM: Eadweard Muybridge. Down at Stanford. 


MM: Yeah, down at Stanford. | see that this actually has Ken 


Knowland's name on it, as well as Lillian Schwartz's. So he was 
involved in that, too. | didn't realize that until | looked closely at 
the thing. 


LM: He collaborated with her a few times. 


MM: He is a very creative person. We were in the same department 
for a while. | certainly admired his work very much, and | liked him 
very much as a person. 


LM: It seemed that he started out on the engineer side of the 
engineer-artist collaboration, and then moved over into the artist 
side. And it seemed like you sort of did the same thing. 


MM: I've now known a lot of composers. I've known them long 
enough, and admired them so much, that | realize I'm not a 
composer. I'm really still on the engineering side. But | have enjoyed 
trying some things, doing some things. Trying to get machines to 
compose for me. 


LM: Apparently it was really a remarkable situation at Bell Labs. All 
these artists who weren't working on anything having to do with 
telephones. 


MM: Most of them were just using the facilities, and mostly at night, 
when the facilities were not being used by the research staff. But it 
was an incredible golden age of many, many things. The transistor, 
of course, many of the computer programs like C and Unix, that 
continue to be important. Communication equipment that is now 
tying the world together incredibly closely. Maybe too closely. 


LM: You even put out a record of music from Bell Labs. And Laurie 
Spiegel was your assistant for a while? 


MM: No, she came in, she was a composer, and she did her own 
thing. | never had any assistants. | didn't really want assistants. | 
wanted people to come in and be themselves. And | think | made 
that possible. 


LM: | read an article by Lejaren Hiller [The Computer and Music, 
edited by Harry B. Lincoln, 1970] where he talks about what you did, 
but he makes it sound like he did it first, with the “Illiac Suite.” 


MM: Well, what | did was different from Hiller. Hiller did the “Illiac 
Suite" first. This was a composing program that composed the suite. 
It was played then by a live string quartet. That was really a very 
difficult feat, much more difficult than what | did. All | did was to 
make the computer play music. | certainly did that before he got into 
that domain. | don't know how far he got into it, actually. He was 
more interested in composing and getting machines to compose. 


LM: You were saying you wanted to get computers to compose for 
you. 


MM: Well, I've just done some games, and things like that. Like this 
graphic scores thing. Most of the compositions that my programs 
have made, | don't like them. A few of them | like. 


LM: John Chowning mentioned that you did a piece where one song 
metamorphosed into another song, and he was impressed with 
that. 


MM: That was a graphic score. If you're making the melody as 
a function of time, for one piece, you can also make a different 
melodic line for another piece, and then you can make a weighted 
average between these two lines. Just a mathematical statement, 
saying 90% of this line and 10% of this line, and that will make 
a melody that sort of falls in between the two. So this particular 
example is called “International Lullaby.” It's by me and a Japanese 
friend who worked with me for many years, Osama Fujimura. It 
converts a Japanese melody, a traditional cradle song for babies, 
into the Schubert "Cradle Song." The Japanese melody is in the 
pentatonic scale, and the Schubert is in a normal key, | think the 
key of C. Anyhow, the conversion is in seven steps. The first step is 
100% Japanese, and the last step is 100% Schubert, and then you 
take one divided by seven and figure out how much percentage you 
go each step. 


LM: Hiller mentioned a piece where you used “Johnny Comes 
Marching Home." 


MM: That's another one. These are the two averaging functions. So 
you start out with 100% "Johnny," and 0% “British Grenadiers,” and 
then you gradually convert to 100% “British Grenadiers,” and then 
you convert back to 100% "Johnny." The "International Lullaby” went 
in steps, but in this one, the conversion functions are continuously 
changing. The "Grenadiers" is in 6/8. “Johnny” is in 4/4. The rhythmic 
transformations are kind of interesting, | think.. 


LM: One of the better-known things you did was the piece that 
Stanley Kubrick used in 2007. 


MM: The people who did the interesting parts of that were John Kelly 
and Carol Lockbaum, because they did the singing. They actually 
used what is called a “physical model,” which in this case is a tube 
model of the human vocal tract. They took the vocal tract and they 
simulated its shape with a bunch of sections of cylindrical tubes 
of different diameters, plotting to the cross-sectional areas of the 
vocal tract. And then they used some studies of a fellow in Sweden 
who had studied Russian vowels, and who knew what the shape of 
the vocal tract had to be to produce various vowel sounds. | guess he 
also had some data on fricative sounds. This was about 1963. Which 
is amazingly early for this kind of thing. So that produced the piece 
with Kubrick was charmed by. It's called "Daisy, Daisy." 


LM: How did Kubrick find out about this? 


MM: He came around to Bell Labs to find out about telephones and 
telecommunication equipment for his space station, or his rocket to 
Jupiter. And John Pierce got ahold of him. Anyone that John grabbed 
ahold of had to listen to this kind of thing, whether he wanted to or 
not. Kubrick wanted to, and decided that would be the swan song 
for Hal, the bad computer. 


LM: When did Bell Labs come to an end? 


MM: It gradually died. | retired in ‘87 and came out to Stanford, and 
have been there ever since. 
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SELECTION SONGS: 


EVOLUTIONARY MUS 


by Lee Spector, Jon Klein, and Kyle Harrington 


In this article we provide a brief introduction to the use of 
evolutionary computation in the arts, focusing on two approaches 
that we have taken in our own work on the evolution of music- 
making systems. 


Evolutionary Computation 


Evolutionary computation is an area of computer science in which 
methods inspired by genetics and evolutionary biology are harnessed 
to explore vast search spaces and to solve computational problems. 
Several people have used these methods for artistic purposes, driven 
in part by the obvious creative track record of biological evolution. 


One motivation for working with evolutionary models in the arts 
stems from our inability to build creative computer systems in many 
other ways—we are largely ignorant of the algorithmic principles 
of creativity, but evolution is crafty and evolutionary computation 
systems have a demonstrated capacity to find solutions beyond 
human devising. The hope, and in some cases the experience, is 
that systems based on evolutionary principles will produce artworks 
beyond the imaginative limits of the humans who design them. For 
surveys of some of this work see (Todd and Latham, 1992), (Bentley 
and Corne, 2001), (Whitelaw, 2004), and, for music applications in 
particular, (Todd and Werner, 1998). 


Genetic programming is a subfield of evolutionary computation 
in which the evolving digital "organisms" consist of executable 
program code. In other words, it is software that evolves in a genetic 
programming system. If one wants to evolve music-making or art- 
making programs, rather than individual pieces of music or works of 
art, then it is natural to use genetic programming rather than other 
forms of evolutionary computation. 


The genetic programming process begins with a population of 
randomly generated programs, made from the elements of an 
appropriate problem-specific “primordial ooze." Each program 
is then tested for "fitness," typically by running the program on 
appropriate problem-specific inputs, and the fitter programs are used 
to produce the next generation of programs. "Child" programs are 
produced from fit parents by direct copying (“survival of the fittest"), 
mutation (in which minor random changes are introduced), and 
sexual crossover (in which random components are combined from 
two fit parents). The process is iterated for many generations, until a 
sufficiently fit program is found; for details see (Koza, 1992). 


Evolving Music 


Several people have applied genetic programming to music; for 
example a search for "music" in the on-line genetic programming 
bibliography,’ currently finds 18 matches. The relatively large 
number of applications to music may be due to the same factors that 
facilitated musical applications in the earliest days of computing 
technology, particularly the ease of representing musical scores 
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using modest quantities of numerical data. But musical applications 
also present a unique challenge with respect to fitness assessment. 


What makes a collection of artworks or an artist fit? In many 
systems the fitness of evolving art-making programs is assessed 
by human artists/users who observe and judge the quality of the 
artistic outputs that the programs produce. For visual art systems 
this can be done relatively efficiently by displaying an array of visual 
representations, sometimes nine or sixteen or even more, on screen 
at one time for rapid scanning and assessment. Typical applications 
of genetic programming use population sizes in the thousands, so 
human fitness assessment is a bottleneck even with this "parallelism" 
of display and judgment. Nonetheless, parallelism can sometimes 
help significantly. 


Music presents a more severe problem, however, since our ears cannot 
make simultaneous sense of multiple independent musical pieces. 
Human fitness assessment therefore requires serial processing, which 
can be tedious. The genetic operators of mutation and crossover 
are "blind" to quality and often produce garbage, which is usually 
acceptable as long as they also occasionally produce improvements. 


ra) 


Figure 1. Evolved music-producing SuperDuperWalkers. 


But serial human sorting of all of the garbage can be a major chore, 
and the long-term exposure to such garbage can numb one's ears to 
the sought-after quality so that it becomes progressively harder to 
make good discriminations. We have recently begun to explore the 
use of portable mp3 players to assist in this process, but this is not 
a complete solution. 


Another approach to the fitness bottleneck is to automate fitness 
testing. But is it possible to write a program that makes aesthetic 
judgments? And would the judgments be good enough to drive the 
evolution of good art-making programs? Would it be as hard to 
make good judgments as it would be to produce good art in the 
first place? 


Many of us in the field have been heartened by comments of arts 
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Figure 2. Evolved music-producing SuperDuperWalkers. 


educators that aesthetic judgment is at least easier to teach than 
aesthetic production. For example Irwin R. Blacker, in The Elements 
of Screenwriting, writes, "The teacher can't give students an ear for 
dialogue, but he can show the differences between good and bad 
dialogue. He can't teach students how to invent a plot, but he can 
teach them to see the flaws and weaknesses of a plot” (Blacker, 
1986). 


Genbebop 


Taking the possibility of cyber-criticism as a hypothesis we turned 
to jazz method books, primarily Baker's (Baker, 1988), for critical 
principles that might be built into a jazz cyber-critic. In particular, 
we attempted to extract unambiguous, algorithmic criteria for 
the assessment of musical responses to musical "calls." That is, 
we wanted rules to determine the quality of a musician "trading 
four," to use the common jazz idiom. The criteria that we developed 
were: 


¢ Tonal novelty balance: A good response should contain a roughly 
even mix of interval sequences that can be found in the jazz corpus 
(for which we used a small collection of Charlie Parker tunes) and 
new interval sequences. 

e Rhythmic novelty balance: The same as tonal novelty balance, but 
for rhythm. 

e Tonal response balance: A similar balance should exist between 
material "echoed" from the call (in a call/response pair) and new 
material. 

¢ Skip balance: Good melodic lines generally mix diatonic movement 
with larger intervals. 

e Rhythmic coherence: Rhythmic sequences violating playability 
constraints should be penalized. 


Using a fitness function based on these criteria, and a primordial 
ooze of music-making functions that would allow the evolved 
programs to transform musical calls into musical responses in a 
wide variety of ways, we were able to use genetic programming to 
evolve "fit" jazz-making programs (Spector and Alpern, 1994; sound 
samples available online’). To say that they were fit is not, however, 
to say that they were interesting! Indeed, evolution found "cheap" 
ways to meet the fitness criteria, for example by echoing half of a 
call and resting for the remainder. The cyber-critic was too easy to 
please and provided little more than a sanity check. 


To extend this work we turned our attention to the production of 


smarter critics. We considered a variety of techniques, including 
the recursive application of evolution, using genetic programming 
to evolve critics. We settled instead on the use of neural networks 
that were trained to distinguish "good" from "bad" call-response 
pairs. The result was a critic that did appear, on informal testing, to 
have some sense. For example it appreciated some Charlie Parker 
sequences that it hadn't heard during training (along with at least 
one Jimi Hendrix solo), while it gave low scores to most random 
sequences. But the trained critic did not provide sanity checks, and 
musicians evolved using the critic as a fitness function produced 
unplayable rhythms over unplayable ranges. We solved this problem 
by using a “committee” of critics: we ran both our original rule- 
based critic and the trained neural network critic and averaged 
their judgments. This allowed evolution to produce a musician that 
was neither trivial nor psychotic, although our analysis was only 
preliminary (Spector and Alpern, 1995). 


Selection Songs 


More recently we have begun to explore more “ecological” notions 
of evolutionary music computation. In the work described above, 
the evolving programs never interact with one another or with 
the world (aside from a musical database); they simply respond to 
musical "problems" with musical “answers.” In contrast, in some of 
our more recent work the evolving programs control complex virtual 
organisms that move around and interact in complex 3D virtual 
worlds such as “SwarmEvolve" (Spector and Klein, 2002; text, sounds 
and movies available online*). Music production is just one among 
the many activities of the virtual organisms in SwarmEvolve, along 
with flying, eating, reproducing, and sharing energy. In this system 
the music is “epiphenomenal"—it is a side-effect of the actions and 
interactions of the organisms. The music reflects the dynamics of 
the virtual world, but it has no effect on that world. (For other work 
on music-producing swarms see Blackwell and Bentley, 2002.) This 
work could be extended by allowing the evolving organisms to hear 
and to respond to the music. In this way the music might become an 
essential component of the virtual ecology. 


In our most recent work we have continued to explore 
“epiphenomenal" music generated by evolutionary processes 
operating in 3D virtual worlds. We began with a system called 
"SuperDuperWalker" that was designed to support experiments on 
the evolution of locomotion (Spector et al., 2005).* In this system 
a genetic algorithm is used to search the space of possible limb 
numbers, proportions, and controllers for multi-legged "walking" 


Figure 3. Evolved music-producing SuperDuperWalkers. 
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creatures, the fitness values of which are determined by distance 
traveled. The term "walking" is a bit misleading here—evolution is 
creative and often generates creatures that wriggle, roll, or even 
fling themselves across the virtual world. 


We produced a musical version of SuperDuperWalker by associating 
sounds with all of the significant events in the virtual world. For 
example, when legs strike the ground they make piano tones, with 
higher tones resulting from strikes further from the creature's 
starting location. A continuous tone indicates the distance of the 
creature's body from the starting location, and additional sounds are 
generated by joint motions and by contact between the creature's 
body and the ground. These creatures are tested one at a time, with 
an additional sound indicating the transition between fitness tests. 
The character of the “songs” produced by the natural selection 
process change over evolutionary time, and the overall composition 
created by the evolutionary process develops in interesting ways. 
The resulting music is often interesting because it results from a 
complex, adaptive process that is constrained—as is human musical 
performance—by the physical properties of articulated 3D bodies. A 
sample movie, with sound, is available online,® and screen snaps are 
shown in Figure 1. 


An extension of this work might use fitness functions that incorporate 
explicit assessment of the aesthetic value of the creatures’ musical 
output, thereby increasing the selection pressure for the production 
of interesting music. The required assessments might be produced, 
for example, by the critics from the Genbebop project described 
above. This would introduce aspects of human musical idiom into 
the evolving virtual ecology. 


Prospects 


We have provided only a brief sampling of our projects in evolutionary 
music computation, which in turn constitute only a small sample of 
the work in this field that is being produced by a large and growing 
community of artists and technologists. Many other strategies exist 
for applying evolutionary computation technology to music and to 
other arts, and many of these strategies can be hybridized with one 
another in a variety of ways. 


The prospects for this kind of work in the future are, in our view, 
very good. Evolutionary computation is a powerful technology with 
unusual creative potential. Applications of this technology to music 
and other arts are often relatively easy to engineer, as one can build 
on the long history of work on algorithmic music composition and 
use the many tools for digital audio and multimedia production that 
are now readily available. 


We have found evolutionary computation to be an engaging and 
rewarding tool for artistic exploration, and we expect to see it used 
by more artists and musicians in the future. 
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(Footnotes) 


INTERVIEVV WITH HENRY VVARWICK 


by Christina McPhee 


Henry was commissioned by Christina McPhee to use data from an 
atmospheric science outpost in Kansas to generate music for her Slipstream/ 
konza project. To do this he used a technique developed by John Cage and 
Lejaren Hiller in their landmark work of computer music, HPSCHD. This 
interview discusses these techniques and strategies. 


On semiotics of sound from data 


CM: Essentially it remains a problem of topology. How do you ‘show' 
or create a ‘listening’ environment which condenses diurnal data 
fields into condensed topologies that are metaphors of the decline 
of photosynthesis from August to December? 


The part | can't quite see is how to preserve the autochamber 
sequence of meanings stretched over a live data dynamic. 


HW: You discuss a question of topology re: mapping / moulding 
the data provided in such a way that is humanly readable and 
understandable. Whether this uses Max/MSP or Ableton is another 
question, quite apart from the topological issue. 


CM: | mentioned “live data”. 
HW: There is no live data in autochamber. 


Live, i.e., synchronic data is characterised by its fluctuation in a 
continuous manner between a data generator and a data receiver, 
such that the data is only an experience of 1:1 synchrony between 
the generator and receiver. There might be a short delay (such as the 
speed of sound, or light, or electricity over wire, etc.) or even a long 
delay (where data is buffered and then sent) but the point is, there 
is no replication possible as it is experiential. 


singer -> (sound) -> listener 
is live, synchronous. 


singer -> (sound) -> (recording device) -> (media) -> (sound) -> 
listener 


is not live. It is diachronous. The media can provide identical (or 
nearly identical) data every time, like this: 


singer -> (sound) -> (recording device) -> (media) -> (sound) -> 
listener 
(media) -> (sound) -> listener 
(media) -> (sound) -> listener 
etc. 


There are mixes between the two, such as: 

composer -> (media, sheet music) -> (ensemble) -> (sound) - 
> listener the media is diachronous, but the performance of the 
ensemble in performance is synchronous to the listener / receiver, 
but diachronous to the composer as it is a mediated relationship via 
the sheet music. 


CM: Autochamber has a similar structure. It is not a live structure 
- it is not synchronous at all? 


HW: Think of it this way: 


OBJECT (Autochamber) -> 

GENERATOR (Satellite and ground machines record natural data 
autochamber machines record data of C02 etc. of prairie) -> 
MEDIA (Excel spread sheets / Excel spread sheets)-> 

MEDIA READER (software that converts data to sound directly / my 
eyes and hands enter data into processor controllers in software)-> 
MEDIA (a CD or DVD)-> 

LISTENER 


| spent a lot of time typing stuff and moving GUI components in 
a program that does a certain number of things to process sound. 
We are using natural data sources, i.e., data sources that are not 
precisely predeterminable by any known mathematical algorithm, 
even if their overall value can be predicted with little accuracy 
but generally correct in aggregate. There are some that can model 
approximate the behaviour, but these models are EXTREMELY 
complex and require supercomputers, and even still, they only come 
up with approximations. Autochamber's natural data source is a 
controlled experiment that produced data of a specific character. 
If you ran the same experiment next year, you would likely get very 
similar data, as CO2 production always decreases from Summer to 
Winter (hence the prediction of general data values in aggregate), as 
do all the different life processes of vegetation in the prairie. 


Elements of Cage 


Cage used a similar process for many of his works. The (idealised) 
structure of Cage's typical process is like this: 


composer, Cage -> (random generator, | CHING) -> (media, sheet 
music) -> (ensemble) -> (sound) -> listener 


or, to quote Cage, from his book, M: 


the sounDs 
of the bUgle 
were out of my Control 
tHough without 
my hAving 
Made the effort 
they wouldn’t have been Produced. 


This is actually a bit of a conceit, because any given score generated 
by a randomising system (in his case, an elaborate coin toss) is 
subject to his approval or disapproval. This conceit is a necessary 
one. If Cage tossed a coin, and (by some random fluke) it produced 
the theme to Deutschland Uber Alles or The Internationale, | doubt 
that he would have kept that set of coin tosses. 


We are using data from outside ourselves, created by natural 


phenomena (Cage: coin toss, myself: autochamber data) in order 
to generate or process an audio environment for an installation or 
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performance, and we have no predetermined control over the data 
itself: we simply control how the data is used (Cage arranging it for 
notation to control performers, myself using it to adjust parameters 
of audio software processors). There is an inverse technological 
correlative to this: ultra-strong encryption systems using natural 
systems (radioactivity) to generate random number sequences. 


Part 2: Differences 


The difference between Cage and [autochamber] is that Cage's 
fundamental device may be indeterminate, but he uses the 
indeterminacy as a tool, like a brush, to fill in the music. Autochamber 
uses data derived from natural phenomena, and the chaos and 
patterns within, as controlling devices central to the object itself. 
This is especially underlined in Autochamber, where the data is used 
to manipulate processors that are acting ona field recording of the 
data generators themselves, making the piece self-referential and 
self-identified. 


The form of the work is derived from recordings of the autochambers 
in situ, that are processed by the data generated from the 
autochambers themselves. How the data was used becomes the 
interesting point, as it reflects the sensibility of the art and the 
artist. | use the datasets to inform my toolsets to process the audio 
in order to make my creative statement. In this way, | am not tied 
to a given toolset, or a given dataset. I'm using data from Excel 
spreadsheets as interpretable datapoints to control audio processing 
in an application. 


Initial Conclusions 


1. autochamber, and Cage work from similar places: using 
unpredictable data to make diachronous datasets that control 
performances. 

2. Cage uses the data in order to fill works, while autochamber use 
these data itself as a part of the content. 

3. Making something “human scaled" is fairly simple by re-assigning 
time values. The diachronous nature of the source data permits 
this. 


A mimetic strategy 


CM: Tell me again what time frame you were working with, is it the 
full 3 months fall into winter (hence yielding the frenzied activity 
early on and then quiet at the end save for the lovely creak of the 
robot in the wind?) 


HW: The first 4 minutes (the loud fidgety part) is derived from the 
first 4 days of the data. 


The second "wind" part is from the last 4 days. 
The data supplied re: CO2 has a 2hr interval. So each sample sets a 5 
second interval in the music, which makes one minute = one day. 


Using this method, each month = approx. 1/2 hour, so a 3 month 
season = 90 minutes or so of audio. A 4 month season = 2 hours. 
It formed an intriguing problem: since | haven't the time to build a 
custom app, | had to use something off the shelf (Ableton Live and 
various VST plug ins I've DL'd from the net). The thing is, these apps 
are not friendly to raw data - they're made for musicians and sound 
designers for their intuitive use as instruments, so the nomenclature 
and calibration and organisation of the program reflects musical 


28 » YLEM JOURNAL - Spring 2005 


interests, not data analysis. So, | have several hundred data points: 
how does something like the CO2 data get integrated into, say, the 
bass response? 


Well, | saw that the EQ has a 15 dB range, +. So, | roped off certain 
dB to correspond with values 1 - 10. So, values 0 through 1 = -15 
through -12, and so on. So | would sit with a little "cheat sheet" 
and look up the value and apply it. An interesting part is, audio is 
logarithmic - every rise of 6 dB is an apparent “doubling” of loudness. 
So the extreme ends of the scale are quite extreme. This is good, as 
it provides a lot of contrast, and the contrast enhances the ability to 
distinguish parts in it. 


The “art” of this exercise has been selecting the data ranges from 
the columns that are most useful. Sometimes the CO2 data isn't 
as useful as the data from something else, such as the average 
temperature, or the radon levels. In that case, | would use the data 
from that column, but | would always use the data from the proper 
*time range* to maintain some integrity in the data. This lends an 
element of mimesis and portraiture: odd traditional art notions that 
one would rarely associate with this kind of electronic music, but 
that deepen and enrich the experience of listening to the music. 


In fact, in my approach to dealing with this data / music, | am 
specifically referencing techniques used by John Cage and Lejaren 
Hiller's in their piece HPSCHD. 


Several months ago, | arranged that piece to be performed by my 
computer, using Ableton Live. However - it was a “performance” as 
expected by the composers from a home stereo unit, in fact Hiller 
is quoted as saying: “the home listener's hi-fi set is integral to the 
composition". 


HPSCHD, as recorded for Nonesuch Records in 1969, is composed 
of 51 tapes and three harpsichord players. The players (Antoinette 
Vischer, Neely Bruce, and David Tudor) are playing excerpts from a 
source work “Introduction to the Composition of Waltzes by Means 
of Dice", attributed to W.A. Mozart. The sectioning and playing of 
these excerpts was conditioned and processed by a computer. One 
section of solo allows the performer to play anything by Mozart they 
so choose. The tapes are a collection of tones and sounds in an equal 
tempered scale of 56 tones per octave. The patterns are overlaid and 


VCLUME TREBLE BASS 
TIME CH.ei CHe.2 CHe1 CHe2 CHei CHe2 
0.00 4 2 1 2 1 u 
C5 4 2 1 2 1 4 
iC 4 2 pe 4 1 4 
15 4 2 1 4 0 4 
Pray 4 2 = 8 4 0 4 
025 4 ra a 4 i) 4 
~3C 4 2 1 0 i) 4 
225 4 2 i 0 4 4 
o4f 4 2 i 0 4 4 
045 4 2 1 0 4 4 
250 4 2 i 0 4 C 


continually change, resulting in a dense thicket of electronic and 
harpsichordal sounds. This is then routed to perhaps the most useful 
part of the piece: the score that is distributed with the record itself. 
A computer printout was supplied with the record, and in data that 
looks like this: 


Time moved in 5 second increments, and every five seconds, the 
listener had to adjust the volume, bass, and treble of their stereo 
set to the above noted values ranging from 0 to 4. | recorded the 
vinyl LP -scratches and all - directly into my computer and then 
programmed the above noted values supplied with the LP into 
Ableton Live, treating the program like a stereo set. Only, | don't have 
the time pressure of performance: | was shifting the emphasis from 
a synchronic art of performance to a diachronic art of composition 
- all done in a computer, so that a computer would thusly "perform" 
the composition of this music which was developed on a computer 
some 35 years ago as a fulfilment of the performative compositional 


So too, | interacted with the vagaries of a simple-to-use piece 
of audio composition software and its components. In this way, 
Autochamber "stands on the shoulders" of HPSCHD, while it looks 
to a very different horizon. Autochamber is as much a work in 
conceptualism as HPSCHD, however, Autochamber's choices of 
processing parameters make for a more inviting and rewarding 
listening experience, as HPSCHD is exhausting and unrelenting in its 
aleatory, dissonances, and density. A part of this is that the processes 
acting upon the Harpsichords in HPSCHD are not derived from the 
Harpsichord or the Harpsichord playing - they are randomly derived 
from a Chaos Engine - the throw of die, the toss of coin. 


PD FS eS ee 


Spee nene cn ame pe sess een er nemo an ae 


HPSCHD 
(pte eee Py a aa Pa eer se ee ee ra ee ee ee eee 


LUCE Oe ee ee 


BR nn te cy a Da i Ot i cd la i a i a i ht a ht a a Clear Envelope) 


Figure 2: an example of the Ableton Live version 4.1 user interface 


strategy provided by the composers. | hope to release this recording 
as a CD soon. 


In any case, | saw that this kind of an approach would work well for 
autchamber - instead of using the random data generated by Cage 
and Hiller to process pre-recorded sounds as a live performance on 
a stereo system (or as a dataset for computer software, in my case) 
| could use the data generated by the autochambers to process the 
audio recorders of the autochambers in software, as noted earlier. 
Since the data provided is all diachronic excel spreadsheet data, 
and the audio is not a live onsite broadcast, but merely compressed 
mp3 files of cassette recordings supplied by the scientists, and is 
thusly not only diachronic but of a degraded and processed texture 
to begin with, it only made sense to take this fashioned thing and 
change it further, building on the strengths of the software at hand, 
the patterns in the datasets, and the Cage/Hiller performance- 
composition strategy in HPSCHD. 


Autochamber starts where HPSCHD leaves off - volume, treble, and 
bass are also manipulated by channel, but so are some other common 
processors (echo, reverb) and some more esoteric time based audio 
scrambling processors which randomly mulch sounds according to a 
certain few time based parameters. 


This data could have been fed into a Max/MSP patch to do the 
scrambling, but building the necessary patches and testing them 
would have taken more time than the few evenings | had budgeted 
to do this, so | simply sat down and ground out the data entry 
into Ableton Live. Also, by using "off the shelf" software and free 
downloadable plug-ins, a questioning finger points directly at the 
technological nexus of HPSCHD and autochamber itself: HPSCHD 
was developed on what was, then, state-of-the-art computers. 
But the final result was left to the random manipulations of a 
comparatively low-tech stereo system and the vagaries of a human 
interacting with it. 


Autochamber is taking the data from the machinery we are listening 
to, and processing the sound of the machinery itself, making for 
a more coherent aesthetic object and statement. With each day 
lasting one minute, the piece would last an hour and a half based on 
the data supplied. One notices in changes of the audio the changes 
in the environment of the autochamber itself, as it reported the 
changes in data. In this way, the autochamber describes itself and 
its world in a more evocative and understandable way. 


Henry Warwick is an interdisciplinary artist who specialises in digital 
media. Equally at home in digital video, electronic music and digital 
imaging, his work examines contemporary society as dominated 
by the impacts, both inspiring and catastrophic, of technology, 
geopolitical economy, demographics, and culture on human society. 
His works are held in private collections around the world. He has 
an MFA inInterdisciplinary Art from Goddard College. He lives in San 
Francisco, California. He is also former vice-president of YLEM and 
the deigner of this Journal. 


Christina McPhee is an internationally recognised artist whose work 
spans a variety of disciplines ranging from digital video and imaging 


to painting and installation that often deal with issues of place, and 
the effects of technology on and of perception. 


For more on Henry Warwick, go to his website: 
http://www.kether.com 


For more on Christina McPhee, go to her websites: 


http://www.christinamcphee.com 
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SPECIAL YLEM CD INFORMATION 


LIST OF MEDIA FILES 
ON THIS:CD: 


CHOWNING : 
Stria : mp3 audio file. From the Aloum ‘John 


Chowning’ (WER 2012-50). Courtesy of WER- 


GO/Schott Music & Media GmbH, Germany. 
Full aloum available at www.wergo.de. 


EVANS: 
AMAZILIA : mpeg video file 
LIMOSA : mpeg video file 


GARTLAND-JONES: 
CeruleanLoops.mp3 : mp3 audio file 
evolution-end.mp3 : mp3 audio file 
evolution-free.mp3 : mp3 audio file 
evolution-harmonic.mp3 : mp3 audio file 
evolution-start.mp3 : mp3 audio file 
nGenAudio.mp3 : mp3 audio file 
topography1.mp3 : mp3 audio file 
topography2.mp3 : mp3 audio file 
topography3.mp3 : mp3 audio file 
topography4.mp3 : mp3 audio file 


HIZUME: 
fibonaccikck-Hizume.mid : MIDI file 
ttktk-Hizume.mp3 : MP3 audio file 


MATHEWS: 

01 daisy.mp3 : mp3 audio file 

02 grenadier-johnny.mp3 : mp3 audio file 
03 improv_for_olympiad,p3 : mp3 audio file 
05 masqueradesstereo.mp3 : mp3 audio file 
06 numerology.mp3 : mp3 audio file 

07 pierce1963seasounds.mp3 : mp3 audio file 
08 Queen.mp3 : mp3 audio file 

09 secondlaw.mp3 : mp3 audio file 

10 silver.mp3 : mp3 audio file 

11 sliderstereo.mp3 : mp3 audio file 

12 stochatta.mp3 : mp3 audio file 

13 swansong.mp3 : mp3 audio file 

14 trumpet.mp3 : mp3 audio file 


SPECTOR: 
selection-songs.mov : QuickTime movie 
selection-songs.mp3 : mp3 audio file 


WARWICK: 

slipkonzasmash.mp3 : mp3 audio file (in col- 
loaboration with Christina McPhee) 

HPSCHD.mp3 : mp3 audio file (composed by 
John Cage and Lejaren Hiller, performed and 
arranged by Henry Warwick) 


YLEM DIRECTORY AND JOURNAL: 


YLEM_Directory.pdf : Membership Directory com- 


piled and developed by Torrey Nommesen. 


YLEM_Journal.pdf : A PDF version of this Journal. 
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This special edition of the YLEM Journal includes a CDR with not only audio by featured guests and subjects of 
(and in) this edition of the Journal, but also the annual YLEM Membership Directory! 


The audio files are in the form of MP3 files. These files can be played on any device that supports the MP3 
standard, such as an iPod or Nomad, as well as any number of computer software MP3 players, such as Apple 
iTunes or WinAmp. 


The video files are all in QuickTime, a product of Apple Computer. In order to view the videos you will have to 
install the QuickTime player which is available for free from Apple Computer at 


http://www.apple.com/quicktime, 


One track by Hizume is a MIDI file. It can be played by opening it in Window's Media Player or Apple Quick- 
Time. 


This Journal and of the 2005 Membership Directory are PDF files. To print the PDF you will need Adobe Acrobat 
Reader. This is available for both Macintosh and Windows platforms for free at nttp://www.adobe.co 


john brian andrew : 
CHOWNING | EVN | GARTLAND-JONES | HIZUME | MATHEWS | SPECTOR 


et > 2a TT | 
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This CD is part of the YLEM Journal 
vol.25 no. 6 published October 2005 
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